00000001:02000400:1.0F:1788463080.521336:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788463098.736526:0:3525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788463100.692873:0:3587:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 643 MB/s 00000001:01000000:1.0:1788463100.943120:0:3587:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:2.0F:1788463101.193142:0:3587:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4051 MB/s 00000020:02000000:0.0F:1788463102.028882:0:3617:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gbb63b80 00000400:02000000:1.0:1788463102.875013:0:3632:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.153@tcp [8/256/0/180] 00008000:02000000:3.0F:1788463106.745332:0:3781:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788463169.155281:0:5750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788463183.368127:0:6500:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463183.368133:0:6500:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788463183.368135:0:6500:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788463183.368792:0:6500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000000b10e37 00000080:02000400:3.0:1788463183.368803:0:6500:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788463183.375238:0:6500:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788463183.375253:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788463183.375786:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000067ba69ef) 00000020:00000080:3.0:1788463183.375808:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788463183.436803:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788463183.436891:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788463183.481199:0:6500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788463183.481729:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788463183.481739:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788463183.481750:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3922c 00000020:01000004:1.0:1788463183.481758:0:6500:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788463183.481764:0:6500:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788463183.481768:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000000b10e37 from MGS 00000020:01000004:1.0:1788463183.481772:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788463183.482067:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000173fa5de) 00000020:00000080:1.0:1788463183.482080:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788463183.482174:0:6500:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000000b10e37 from MGS, refs=2 00080000:01000000:1.0:1788463183.482180:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788463183.482185:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3923a 00000100:00100000:1.0:1788463183.482314:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788463183.482709:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788463183.482715:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788463183.483882:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788463183.483891:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788463183.485935:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463183.486118:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788463183.486125:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788463183.487604:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788463183.487616:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788463183.488246:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788463183.488253:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788463183.489260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463183.489264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463183.489266:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463183.489822:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463183.489826:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463183.489828:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463183.490401:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788463183.496693:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788463183.740854:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2055 MB/s 00000001:01000000:2.0:1788463183.991562:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3655 MB/s 00000001:01000000:2.0:1788463184.242279:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 639 MB/s 00000001:01000000:2.0:1788463184.491691:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1211 MB/s 00080000:10000000:3.0:1788463184.497047:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788463184.517345:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1788463184.520035:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463184.521033:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788463184.523943:0:6500:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788463184.524010:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788463184.524248:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788463184.524271:0:6500:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788463184.524661:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463184.524834:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788463184.524841:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788463184.529542:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788463184.529556:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788463184.530138:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788463184.530146:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788463184.531250:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788463184.531275:0:6500:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.153@tcp' 00000020:01000004:2.0:1788463184.531277:0:6500:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788463184.531341:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.153@tcp (typ=mgc) 00000020:00000080:2.0:1788463184.531364:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.153@tcp (00000000022d9663) 00000020:00000080:2.0:1788463184.531382:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788463184.531537:0:6500:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df6c8497@MGC192.168.204.153@tcp: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463184.532627:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.153@tcp-0 is initialized 00000040:01000000:2.0:1788463184.532637:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788463184.539409:0:6520:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788463184.539879:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.153@tcp (uuid 760a69d7-d23f-4a71-8b75-cca21d577f9e) 00000020:00000080:2.0:1788463184.539902:0:6500:0:(genops.c:1385:class_connect()) connect: client 760a69d7-d23f-4a71-8b75-cca21d577f9e, cookie 0x841acb7f42a39248 00000100:00080000:2.0:1788463184.539915:0:6500:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463184.539921:0:6500:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import 00000000df6c8497 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463184.539968:0:6500:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af8b5960 x1875339485642880/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463184.540050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af8b5960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485642880:0@lo:250: 00000100:00100000:2.0:1788463184.540137:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.540202:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485642880 00000100:00100000:2.0:1788463184.540209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485642880 00000100:00100000:2.0:1788463184.540236:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463184.540242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a6b91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875339485642880:12345-0@lo:250: 00010000:00080000:2.0:1788463184.540269:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 760a69d7-d23f-4a71-8b75-cca21d577f9e@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1788463184.540304:0:6516:0:(genops.c:1385:class_connect()) connect: client 760a69d7-d23f-4a71-8b75-cca21d577f9e, cookie 0x841acb7f42a3924f 00000100:00080000:2.0:1788463184.541082:0:6516:0:(import.c:65:import_set_state_nolock()) 000000008cf2ec07 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463184.541168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a6b91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:3647:x1875339485642880:12345-0@lo:250: Request processed in 924us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463184.541177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788463184.541217:0:6500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS 00000020:01000004:2.0:1788463184.541236:0:6500:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788463184.541241:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788463184.541254:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000f511abd) 00000020:00000080:2.0:1788463184.541266:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788463184.541610:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788463184.541621:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.153@tcp: connect to target with instance 0 00000100:00080000:3.0:1788463184.541628:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788463184.541633:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788463184.541636:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000df6c8497 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788463184.541638:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788463184.541645:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788463184.541649:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af8b5960 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485642880:0@lo:250: 00000100:00080000:0.0:1788463184.544112:0:6519:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788463184.557133:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.557331:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463184.557337:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788463184.558341:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463184.558349:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788463184.559072:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463184.559081:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788463184.560158:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.560347:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788463184.560355:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788463184.561120:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788463184.561137:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788463184.599338:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.599839:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788463184.599847:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788463184.601365:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788463184.601378:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788463184.602322:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.602831:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788463184.602848:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788463184.604610:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788463184.604622:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788463184.605309:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.605742:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788463184.605750:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788463184.609900:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788463184.609914:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788463184.611024:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463184.611244:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788463184.611250:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788463184.612313:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788463184.612323:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788463184.628432:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463184.628727:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463184.628735:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788463184.630341:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463184.630354:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788463184.631311:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463184.631319:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788463184.632299:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788463184.632331:0:6500:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788463184.632339:0:6500:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788463184.632474:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463184.632514:0:6500:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788463184.632519:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463184.632520:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463184.632522:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463184.632523:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463184.632524:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463184.632525:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463184.632527:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463184.632528:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463184.632529:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788463184.632530:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788463184.632532:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463184.632533:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463184.632535:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788463184.632538:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463184.632539:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463184.632540:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463184.632541:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463184.632542:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463184.632543:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463184.632544:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463184.632545:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463184.632546:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788463184.632551:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788463184.632552:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463184.632553:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463184.632612:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788463184.632630:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643008:0@lo:253: 00000100:00100000:2.0:1788463184.632718:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.632769:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0572b4c going to sleep for 11 seconds 00000100:00100000:3.0:1788463184.633279:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643008 00000100:00100000:3.0:1788463184.633288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643008 00000100:00100000:3.0:1788463184.633338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463184.633347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa54aa27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6500:x1875339485643008:12345-0@lo:253: 20000000:01000000:3.0:1788463184.633417:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463184.633420:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788463184.633620:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788463184.633655:0:6518:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788463184.633932:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463184.634709:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788463184.634803:0:6518:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463184.634807:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788463184.634812:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788463184.634816:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788463184.634827:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788463184.634924:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463184.635042:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788463184.635054:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788463184.635067:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788463184.635079:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788463184.635090:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788463184.635143:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788463184.635151:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788463184.635161:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788463184.635165:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788463184.635186:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788463184.635191:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788463184.635202:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788463184.635216:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788463184.635240:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788463184.635245:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788463184.635251:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463184.635347:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788463184.635357:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788463184.635371:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788463184.635383:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788463184.635405:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788463184.635412:0:6518:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788463184.635434:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788463184.635441:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788463184.635450:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788463184.635461:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788463184.635473:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788463184.635480:0:6518:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788463184.635497:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788463184.635502:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788463184.635511:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788463184.635522:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788463184.635564:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788463184.635608:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788463184.635614:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788463184.636920:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788463184.637158:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788463184.637186:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.153@tcp for mdt 20000000:01000000:3.0:1788463184.637188:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:3.0:1788463184.637217:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788463184.637224:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788463184.637236:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788463184.637241:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:3.0:1788463184.637252:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788463184.637259:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788463184.637272:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788463184.637287:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788463184.637314:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788463184.637317:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788463184.637322:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788463184.637386:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788463184.637389:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788463184.637999:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788463184.638194:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788463184.638216:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788463184.638230:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788463184.638237:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788463184.638238:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788463184.640073:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788463184.642293:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788463184.642332:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788463184.642348:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788463184.642361:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463184.642363:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788463184.642369:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788463184.642371:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788463184.642377:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788463184.642384:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788463184.643174:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788463184.643361:0:6518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788463184.656146:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788463184.656179:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788463184.656198:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788463184.656218:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788463184.656244:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656261:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656271:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656277:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656302:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656307:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656312:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000039b1622d already unused, calling callback (00000000c265efd7) 00010000:00010000:3.0:1788463184.656316:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656323:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656335:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656342:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.656348:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039b1622d/0x841acb7f42a3925d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463184.656364:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788463184.675227:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa54aa27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6500:x1875339485643008:12345-0@lo:253: Request processed in 41869us (42499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463184.675246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463184.675383:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643008:0@lo:253: 10000000:01000000:2.0:1788463184.675402:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788463184.675405:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463184.675407:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463184.675419:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463184.675421:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788463184.675422:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463184.675424:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463184.675425:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463184.675426:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463184.675428:0:6500:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788463184.675429:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463184.675431:0:6500:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463184.675456:0:6500:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000000b10e37 from lustre-MDT0000 10000000:01000000:2.0:1788463184.675487:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788463184.675490:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788463184.675494:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff961884ff19c0 10000000:01000000:2.0:1788463184.675499:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463184.675507:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff961884ff19c0 from 1 10000000:01000000:2.0:1788463184.675510:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788463184.675548:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.675561:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.675790:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463184.675809:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643136:0@lo:101: 00000100:00100000:2.0:1788463184.675848:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.675912:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a065b5f9 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.676261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643136 00000100:00100000:0.0:1788463184.676269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643136 00000100:00100000:0.0:1788463184.676326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463184.676335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33d3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6500:x1875339485643136:12345-0@lo:101: 00010000:00010000:0.0:1788463184.676349:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463184.676362:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.676385:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39264 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.676395:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39264 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.676672:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000008dfd03, rc 0) 00000100:00100000:0.0:1788463184.676783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33d3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6500:x1875339485643136:12345-0@lo:101: Request processed in 449us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.676790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463184.682723:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643136:0@lo:101: 00010000:00010000:2.0:1788463184.682761:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.682774:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463184.682912:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643264:0@lo:501: 00000100:00100000:2.0:1788463184.682970:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.683194:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a065b5f9 going to sleep for 11 seconds 00000100:00100000:3.0:1788463184.683756:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643264 00000100:00100000:3.0:1788463184.683764:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643264 00000100:00100000:3.0:1788463184.683817:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463184.683825:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a9fcda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6500:x1875339485643264:12345-0@lo:501: 00000100:00100000:3.0:1788463184.683944:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a9fcda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6500:x1875339485643264:12345-0@lo:501: Request processed in 119us (974us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463184.683952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463184.684042:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049665438 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643264:0@lo:501: 10000000:01000000:0.0:1788463184.684090:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788463184.684100:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.684109:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463184.684129:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9618850d0800 10000000:01000000:0.0:1788463184.684135:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788463184.684139:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9618850d0800 10000000:01000000:0.0:1788463184.684141:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788463184.684145:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9618850d0800 from 1 10000000:01000000:0.0:1788463184.684147:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788463184.684187:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.684194:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.684202:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463184.684214:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012d57717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643392:0@lo:101: 00000100:00100000:0.0:1788463184.684249:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.684328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643392 00000100:00100000:2.0:1788463184.684333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643392 00000100:00100000:2.0:1788463184.684357:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463184.684362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abf904af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6500:x1875339485643392:12345-0@lo:101: 00010000:00010000:2.0:1788463184.684370:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463184.684382:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000272d148a/0x841acb7f42a39279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39272 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.684402:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000272d148a/0x841acb7f42a39279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39272 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.684421:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000272d148a/0x841acb7f42a39279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39272 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.684431:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000272d148a, rc 0) 00000100:00100000:2.0:1788463184.684471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abf904af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:6500:x1875339485643392:12345-0@lo:101: Request processed in 108us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463184.684477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463184.689224:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000006ce0a446 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.689276:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012d57717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643392:0@lo:101: 00010000:00010000:0.0:1788463184.689301:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.689313:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463184.689332:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788463184.689344:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.689351:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000cdc2c017/0x841acb7f42a39272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463184.689358:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788463184.689363:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463184.689369:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9618850d0800 10000000:01000000:0.0:1788463184.689372:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788463184.689375:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788463184.689378:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463184.689420:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.689427:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.689435:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463184.690257:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012d57717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643520:0@lo:101: 00000100:00100000:0.0:1788463184.690332:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463184.690383:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000006ce0a446 going to sleep for 11 seconds 00000100:00100000:3.0:1788463184.694177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643520 00000100:00100000:3.0:1788463184.694191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643520 00000100:00100000:3.0:1788463184.694248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463184.694257:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f88b30d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:6500:x1875339485643520:12345-0@lo:101: 00010000:00010000:3.0:1788463184.694274:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463184.694291:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39280 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.694318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39280 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.694329:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39280 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.694338:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039b1622d, rc 0) 00000100:00100000:3.0:1788463184.694427:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f88b30d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+8:6500:x1875339485643520:12345-0@lo:101: Request processed in 172us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463184.694434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463184.694559:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012d57717 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643520:0@lo:101: 00010000:00010000:2.0:1788463184.694606:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.694616:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463184.694690:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643648:0@lo:501: 00000100:00100000:2.0:1788463184.694727:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.694774:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067721d05 going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.694926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643648 00000100:00100000:1.0:1788463184.694932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643648 00000100:00100000:1.0:1788463184.694959:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463184.694968:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a538185d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6500:x1875339485643648:12345-0@lo:501: 00000100:00100000:1.0:1788463184.695093:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a538185d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6500:x1875339485643648:12345-0@lo:501: Request processed in 127us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.695100:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463184.695218:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643648:0@lo:501: 00000100:00100000:2.0:1788463184.695247:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643776:0@lo:503: 00000100:00100000:2.0:1788463184.695294:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.695322:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067721d05 going to sleep for 11 seconds 00000100:00100000:3.0:1788463184.695373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643776 00000100:00100000:3.0:1788463184.695377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643776 00000100:00100000:3.0:1788463184.695417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463184.695425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce495fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6500:x1875339485643776:12345-0@lo:503: 00000100:00100000:3.0:1788463184.695714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce495fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6500:x1875339485643776:12345-0@lo:503: Request processed in 291us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463184.695721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463184.695843:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485643776:0@lo:503: 00000100:00100000:1.0:1788463184.696318:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c8fd75e pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6544:1875339485643904:0@lo:502: 00000100:00100000:1.0:1788463184.696360:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.696449:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d76a68e0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.697265:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485643904 00000100:00100000:0.0:1788463184.697273:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485643904 00000100:00100000:0.0:1788463184.697351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463184.697359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007724fe3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6544:x1875339485643904:12345-0@lo:502: 00000100:00100000:0.0:1788463184.697496:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007724fe3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6544:x1875339485643904:12345-0@lo:502: Request processed in 138us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.697504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463184.697610:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c8fd75e pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6544:1875339485643904:0@lo:502: 00000020:01000000:3.0:1788463184.697639:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463184.697650:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463184.697652:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788463184.697657:0:6544:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788463184.697660:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463184.697674:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000014be0452) 00000020:00000080:3.0:1788463184.697691:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788463184.697696:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788463184.697782:0:6544:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788463184.697789:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a39295 00000020:00000080:3.0:1788463184.698048:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788463184.698053:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463184.698056:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463184.698058:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788463184.698060:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463184.698064:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463184.698065:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788463184.698068:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463184.698075:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000022e24a0a) 00000020:00000080:3.0:1788463184.698084:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788463184.698087:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788463184.698088:0:6544:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788463184.698091:0:6544:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788463184.698097:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788463184.698154:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000000b10e37 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788463184.698167:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008b2c90c4) 00000020:00000080:3.0:1788463184.698174:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788463184.698278:0:6544:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788463184.698284:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a392aa 00000020:00000080:3.0:1788463184.698380:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788463184.698392:0:6544:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788463184.698402:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x841acb7f42a392b1 00080000:01000000:3.0:1788463184.698408:0:6544:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788463184.698411:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a392b8 00080000:10000000:3.0:1788463184.698855:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788463184.698994:0:6544:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788463184.704796:0:6544:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788463184.817007:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788463184.817385:0:6544:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788463184.822291:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788463184.823047:0:6544:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788463184.827000:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fa5dea76) 00000020:00000080:2.0:1788463184.827035:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788463184.827146:0:6544:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788463184.827161:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a392c6 00000020:00000080:1.0:1788463184.827956:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788463184.829360:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.835334:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788463184.845371:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788463184.848222:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788463184.851020:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788463184.853201:0:6544:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788463184.855070:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x841acb7f42a392cd 00000020:00000080:2.0:1788463184.855433:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788463184.855445:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463184.855451:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463184.855453:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788463184.855456:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463184.855468:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463184.855470:0:6544:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463184.855473:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463184.855475:0:6544:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788463184.855477:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463184.855479:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463184.855481:0:6544:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788463184.855483:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463184.855487:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463184.855496:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788463184.855501:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788463184.855552:0:6544:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788463184.855644:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6544:1875339485644032:0@lo:502: 00000100:00100000:2.0:1788463184.855720:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.855766:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set 000000002547d47b going to sleep for 11 seconds 00000100:00100000:3.0:1788463184.855844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644032 00000100:00100000:3.0:1788463184.855851:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644032 00000100:00100000:3.0:1788463184.855884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463184.855892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006db1b544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6544:x1875339485644032:12345-0@lo:502: 00000100:00100000:3.0:1788463184.856009:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006db1b544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6544:x1875339485644032:12345-0@lo:502: Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463184.856018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463184.856242:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6544:1875339485644032:0@lo:502: 00000020:01000000:2.0:1788463184.856272:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463184.856277:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463184.856284:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788463184.856288:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788463184.856462:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788463184.856484:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788463184.856514:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.856524:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463184.856532:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618850d0800 from 1 10000000:01000000:3.0:1788463184.856535:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463184.856601:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.856609:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.856617:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463184.856637:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644160:0@lo:101: 00000100:00100000:3.0:1788463184.856672:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463184.856699:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bc30d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.856775:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644160 00000100:00100000:1.0:1788463184.856782:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644160 00000100:00100000:1.0:1788463184.856806:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463184.856813:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d6fbe43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:6500:x1875339485644160:12345-0@lo:101: 00010000:00010000:1.0:1788463184.856823:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463184.856838:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a392d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.856862:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.856874:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.856890:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c08e155b, rc 0) 00000100:00100000:1.0:1788463184.856921:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d6fbe43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:6500:x1875339485644160:12345-0@lo:101: Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.856928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463184.857144:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644160:0@lo:101: 00010000:00010000:3.0:1788463184.857158:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.857166:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463184.857885:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644288:0@lo:256: 00000100:00100000:3.0:1788463184.857934:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463184.858004:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bc30d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.858363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644288 00000100:00100000:1.0:1788463184.858370:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644288 00000100:00100000:1.0:1788463184.858550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463184.858559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000024c9e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:6500:x1875339485644288:12345-0@lo:256: 20000000:01000000:1.0:1788463184.858609:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788463184.858616:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788463184.858693:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000024c9e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:6500:x1875339485644288:12345-0@lo:256: Request processed in 136us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.858700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463184.858783:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644288:0@lo:256: 10000000:01000000:3.0:1788463184.859351:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463184.859369:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.859381:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463184.859389:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618850d0800 from 1 10000000:01000000:3.0:1788463184.859392:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463184.859437:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.859444:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.860707:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463184.860736:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644416:0@lo:101: 00000100:00100000:3.0:1788463184.860814:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463184.860854:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bc30d1 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.860979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644416 00000100:00100000:0.0:1788463184.860987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644416 00000100:00100000:0.0:1788463184.861076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463184.861087:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a0c9a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:6500:x1875339485644416:12345-0@lo:101: 00010000:00010000:0.0:1788463184.861103:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463184.861134:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a392e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.861165:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.861176:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.861185:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004274a1ed, rc 0) 00000100:00100000:0.0:1788463184.861236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a0c9a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644416:12345-0@lo:101: Request processed in 151us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.861259:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463184.861343:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644416:0@lo:101: 00010000:00010000:3.0:1788463184.861357:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463184.861364:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463184.861825:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644544:0@lo:501: 00000100:00100000:3.0:1788463184.861856:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463184.861875:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bc30d1 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.861938:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644544 00000100:00100000:0.0:1788463184.861945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644544 00000100:00100000:0.0:1788463184.861966:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463184.861971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091b2206b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644544:12345-0@lo:501: 00000100:00100000:0.0:1788463184.862139:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091b2206b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644544:12345-0@lo:501: Request processed in 168us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.862147:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463184.862245:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644544:0@lo:501: 00000100:00100000:3.0:1788463184.862273:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644672:0@lo:503: 00000100:00100000:3.0:1788463184.862310:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463184.862362:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3bc30d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.862439:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644672 00000100:00100000:1.0:1788463184.862443:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644672 00000100:00100000:1.0:1788463184.862474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463184.862481:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5c55694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644672:12345-0@lo:503: 00000040:00080000:1.0:1788463184.862710:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463184.862745:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5c55694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644672:12345-0@lo:503: Request processed in 265us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.862752:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463184.862848:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644672:0@lo:503: 00000040:00080000:3.0:1788463184.863930:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788463184.864111:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788463184.864141:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463184.864161:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864171:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463184.864235:0:6500:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788463184.864238:0:6500:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9618850d0800 10000000:01000000:1.0:1788463184.864241:0:6500:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9618850d0800 10000000:01000000:1.0:1788463184.864245:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463184.864251:0:6500:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618850d0800 from 1 10000000:01000000:1.0:1788463184.864253:0:6500:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463184.864283:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864291:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864300:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463184.864329:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644800:0@lo:101: 00000100:00100000:1.0:1788463184.864387:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.864440:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d49569fb going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.864470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644800 00000100:00100000:1.0:1788463184.864478:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644800 00000100:00100000:1.0:1788463184.864518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463184.864525:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aba11fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485644800:12345-0@lo:101: 00010000:00010000:1.0:1788463184.864536:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463184.864547:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a392f0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864569:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864616:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864624:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065dee744, rc 0) 00000100:00100000:1.0:1788463184.864659:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aba11fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485644800:12345-0@lo:101: Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.864665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463184.864705:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644800:0@lo:101: 00010000:00010000:1.0:1788463184.864717:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.864725:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463184.864773:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644928:0@lo:501: 00000100:00100000:1.0:1788463184.864797:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.864814:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d49569fb going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.864825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485644928 00000100:00100000:1.0:1788463184.864829:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485644928 00000100:00100000:1.0:1788463184.864847:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463184.864851:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034fd6a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485644928:12345-0@lo:501: 00000100:00100000:1.0:1788463184.864954:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034fd6a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485644928:12345-0@lo:501: Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.864962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463184.864989:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485644928:0@lo:501: 00000100:00100000:1.0:1788463184.865013:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485645056:0@lo:503: 00000100:00100000:1.0:1788463184.865054:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.865066:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d49569fb going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.865078:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645056 00000100:00100000:1.0:1788463184.865082:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645056 00000100:00100000:1.0:1788463184.865098:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463184.865103:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e78ac588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485645056:12345-0@lo:503: 00000100:00100000:1.0:1788463184.865184:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e78ac588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485645056:12345-0@lo:503: Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.865191:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463184.865226:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485645056:0@lo:503: 00000100:00100000:1.0:1788463184.865411:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6549:1875339485645184:0@lo:502: 00000100:00100000:1.0:1788463184.865442:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.865458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645184 00000100:00100000:1.0:1788463184.865461:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645184 00000100:00100000:1.0:1788463184.865477:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463184.865482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000617b9e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6549:x1875339485645184:12345-0@lo:502: 00000100:00100000:1.0:1788463184.865548:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000617b9e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6549:x1875339485645184:12345-0@lo:502: Request processed in 65us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.865554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463184.865610:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 000000006466e1b1 going to sleep for 11 seconds 00000100:00100000:1.0:1788463184.865622:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6549:1875339485645184:0@lo:502: 00000020:01000004:1.0:1788463184.865673:0:6549:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788463184.865688:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ee5797d9) 00000020:00000080:1.0:1788463184.865708:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788463184.865779:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000000b10e37 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788463184.865783:0:6549:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000000b10e37 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788463184.865790:0:6549:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000000b10e37 4 00010000:00080000:1.0:1788463184.865818:0:6549:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000080ba35c3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463184.869176:0:6549:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788463184.869446:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788463184.869638:0:6549:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788463184.869655:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x841acb7f42a39305 00000100:00080000:1.0:1788463184.869667:0:6549:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463184.869673:0:6549:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000080ba35c3 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463184.869719:0:6549:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000bdd6a97 x1875339485645312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463184.869745:0:6549:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463184.869936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485645312:0@lo:38: 00000100:00100000:0.0:1788463184.870004:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.870282:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645312 00000100:00100000:1.0:1788463184.870290:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645312 00000100:00100000:1.0:1788463184.870326:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463184.870333:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3793efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485645312:12345-0@lo:38: 00000100:00100000:1.0:1788463184.870384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3793efb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485645312:12345-0@lo:38: Request processed in 50us (380us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788463184.870391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463184.870440:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463184.870447:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000080ba35c3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463184.870451:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788463184.870454:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485645312:0@lo:38: 00000100:00100000:1.0:1788463184.870899:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6549:1875339485645440:0@lo:502: 00000100:00100000:1.0:1788463184.870950:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.870983:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 00000000337c0ad7 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.871025:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645440 00000100:00100000:0.0:1788463184.871030:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645440 00000100:00100000:0.0:1788463184.871075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463184.871082:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b098c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6549:x1875339485645440:12345-0@lo:502: 00000100:00100000:0.0:1788463184.871215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b098c04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6549:x1875339485645440:12345-0@lo:502: Request processed in 132us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.871222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463184.871388:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:6549:1875339485645440:0@lo:502: 00000040:00080000:1.0:1788463184.871422:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788463184.871693:0:6500:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788463184.871721:0:6500:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463184.871741:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.871752:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788463184.871806:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788463184.871808:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463184.871814:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463184.871815:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463184.871816:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463184.871818:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463184.871818:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463184.871820:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463184.871821:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463184.871823:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463184.871824:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463184.871825:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463184.871828:0:6500:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788463184.871831:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463184.871832:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463184.871833:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463184.871834:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463184.871835:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463184.871836:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463184.871837:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463184.871837:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463184.871838:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463184.871839:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463184.871840:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463184.871840:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463184.871856:0:6500:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788463184.871866:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c308a5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485645568:0@lo:253: 00000100:00100000:0.0:1788463184.871907:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463184.871924:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccc578c5 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.871942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645568 00000100:00100000:0.0:1788463184.871947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645568 00000100:00100000:0.0:1788463184.871977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463184.871983:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004861cd63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6500:x1875339485645568:12345-0@lo:253: 20000000:01000000:0.0:1788463184.872004:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788463184.872019:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788463184.878945:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463184.878966:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788463184.879064:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463184.879070:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463184.879092:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.879134:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.879143:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.879189:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.879203:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 12 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463184.879216:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485645696:0@lo:104: 00000100:00100000:2.0:1788463184.879280:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463184.879334:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db934373 going to sleep for 11 seconds 00000100:00100000:0.0:1788463184.879393:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645696 00000100:00100000:0.0:1788463184.879400:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645696 00000100:00100000:0.0:1788463184.879476:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463184.879484:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006fcacb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485645696:12345-0@lo:104: 00010000:00010000:0.0:1788463184.879508:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463184.879597:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463184.879602:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006fcacb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485645696:12345-0@lo:104: Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.879609:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788463184.879686:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463184.879692:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879700:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b61cc5be already unused, calling callback (0000000029e2dd3c) 10000000:00010000:1.0:1788463184.879703:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879710:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463184.879717:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463184.879722:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788463184.879741:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000039c2222 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485645696:0@lo:104: 00010000:00010000:1.0:1788463184.879756:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.879758:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879763:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463184.879782:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879789:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 00000000b61cc5be/0x841acb7f42a392d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392db expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463184.879804:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463184.879805:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463184.879834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485645824:0@lo:103: 00000100:00100000:2.0:1788463184.879861:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463184.879889:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645824 00000100:00100000:1.0:1788463184.879894:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645824 00010000:00010000:1.0:1788463184.879910:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 13 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463184.879940:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463184.879946:0:6509:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788463184.879946:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039c2222 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:3649:x1875339485645824:12345-0@lo:103: 00000100:00100000:2.0:1788463184.879951:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788463184.879956:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463184.879961:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 13 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879969:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 13 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879982:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c08e155b/0x841acb7f42a392db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a392d4 expref: 13 pid: 6517 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.879994:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880000:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463184.880084:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000941664s 00010000:00010000:1.0:1788463184.880089:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880096:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880102:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880108:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880130:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cdcc9dd4 already unused, calling callback (00000000c265efd7) 00010000:00010000:1.0:1788463184.880134:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880141:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.880319:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463184.880332:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880364:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880371:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdcc9dd4/0x841acb7f42a3930c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463184.880387:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463184.880459:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039c2222 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3649:x1875339485645824:12345-0@lo:103: Request processed in 514us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463184.880466:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463184.880685:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004861cd63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6500:x1875339485645568:12345-0@lo:253: Request processed in 8702us (8777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463184.880695:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463184.880740:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c308a5a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:6500:1875339485645568:0@lo:253: 10000000:01000000:0.0:1788463184.880752:0:6500:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788463184.880755:0:6500:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463184.880757:0:6500:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463184.880758:0:6500:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463184.880759:0:6500:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463184.880761:0:6500:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463184.880762:0:6500:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463184.880764:0:6500:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463184.880765:0:6500:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463184.880766:0:6500:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463184.880767:0:6500:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463184.880769:0:6500:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463184.880771:0:6500:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788463184.880781:0:6500:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788463184.882588:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bdd6a97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485645824:0@lo:103: 00080000:10000000:1.0:1788463184.889799:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.890693:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788463184.890995:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.891402:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788463184.891804:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.891962:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788463184.902158:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.902823:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788463184.903134:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.903434:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788463184.903801:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788463184.903971:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788463184.912254:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788463184.946220:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788463184.947327:0:6556:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788463184.949506:0:6555:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788463184.949512:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788463184.955841:0:6556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788463184.961942:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788463184.962063:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788463184.964637:0:6500:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788463184.964660:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788463184.965026:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463184.970600:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788463184.972295:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788463184.972389:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788463184.973483:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788463184.974538:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1788463184.983380:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788463184.989296:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788463184.989604:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000040:00080000:2.0:1788463184.990945:0:6556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788463184.991032:0:6556:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788463184.991036:0:6556:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788463184.991688:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788463184.991829:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788463184.991976:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788463184.992141:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788463184.992328:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788463184.992499:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788463184.992669:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788463184.992821:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788463184.992960:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788463184.996348:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788463184.996982:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788463185.000731:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788463185.001221:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788463185.001538:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788463185.002312:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788463185.002550:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788463185.003357:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788463185.004042:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788463185.004238:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788463185.004374:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788463185.005100:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788463185.005248:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788463185.005890:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788463185.006044:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788463185.006765:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788463185.006955:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788463185.008543:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788463185.008879:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788463185.009030:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788463185.010984:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788463185.018418:0:6500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788463185.018459:0:6500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba47416a7988 00100000:10000000:1.0:1788463185.018479:0:6500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788463185.019455:0:6500:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463185.019472:0:6500:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463185.019491:0:6500:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788463185.019513:0:6500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788463185.020281:0:6500:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463185.020456:0:6500:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788463185.543740:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463186.563828:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463187.587756:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463188.618357:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463189.638750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463189.849802:0:6801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788463189.893938:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788463189.893963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788463189.893968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788463189.893971:0:8:0:(import.c:65:import_set_state_nolock()) 0000000080ba35c3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463189.893987:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000080ba35c3 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463189.894013:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fdd7e621 x1875339485646080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463189.895693:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fdd7e621 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485646080:0@lo:38: 00000100:00100000:0.0:1788463189.895775:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463189.897291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a45ed513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485645952:0@lo:400: 00000100:00100000:1.0:1788463189.897364:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463189.897699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485645952 00000100:00100000:0.0:1788463189.897709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485645952 00000100:00100000:0.0:1788463189.897767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463189.897775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022fa70d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:3651:x1875339485645952:12345-0@lo:400: 00000100:00100000:0.0:1788463189.897834:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022fa70d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:3651:x1875339485645952:12345-0@lo:400: Request processed in 59us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463189.897841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463189.898015:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a45ed513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485645952:0@lo:400: 00000100:00100000:3.0:1788463189.904328:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646080 00000100:00100000:3.0:1788463189.904347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646080 00000100:00100000:3.0:1788463189.904394:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463189.904401:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c308a5a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485646080:12345-0@lo:38: 00010000:00080000:3.0:1788463189.904429:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788463189.904490:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x841acb7f42a39313 00000004:00100000:3.0:1788463189.904548:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788463189.904689:0:6524:0:(import.c:65:import_set_state_nolock()) 0000000049ddb92b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463189.904779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c308a5a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875339485646080:12345-0@lo:38: Request processed in 376us (9004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463189.904787:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788463189.905491:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fdd7e621 x1875339485646080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463189.905510:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788463189.905516:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788463189.905521:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463189.905523:0:3647:0:(import.c:65:import_set_state_nolock()) 0000000080ba35c3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463189.905529:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fdd7e621 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485646080:0@lo:38: 00010000:00010000:3.0:1788463190.661657:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463190.907936:0:6853:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463190.908158:0:6853:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788463191.692780:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463192.707851:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463192.966895:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463192.966907:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618850d0800 from 3 10000000:01000000:3.0:1788463192.966913:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463192.966977:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463192.966992:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463192.967005:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463192.967033:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485646208:0@lo:101: 00000100:00100000:3.0:1788463192.967105:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463192.967161:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4cbd080 going to sleep for 11 seconds 00000100:00100000:0.0:1788463192.969564:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646208 00000100:00100000:0.0:1788463192.969603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646208 00000100:00100000:0.0:1788463192.969660:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463192.969669:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a2cf46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:6520:x1875339485646208:12345-0@lo:101: 00010000:00010000:0.0:1788463192.969689:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463192.969707:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3931a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463192.969736:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3931a expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463192.969746:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3931a expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463192.969762:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cb26c51, rc 0) 00000100:00100000:0.0:1788463192.969842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a2cf46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6520:x1875339485646208:12345-0@lo:101: Request processed in 174us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463192.969850:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463192.970712:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315005 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485646208:0@lo:101: 00010000:00010000:2.0:1788463192.970735:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463192.970745:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463192.970815:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004ef8c477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485646336:0@lo:256: 00000100:00100000:2.0:1788463192.970876:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463192.970925:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000348612fc going to sleep for 11 seconds 00000100:00100000:0.0:1788463192.973974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646336 00000100:00100000:0.0:1788463192.973992:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646336 00000100:00100000:0.0:1788463192.974160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463192.974170:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006be34137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6520:x1875339485646336:12345-0@lo:256: 20000000:01000000:0.0:1788463192.974195:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463192.974213:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463192.974217:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788463192.974338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006be34137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:6520:x1875339485646336:12345-0@lo:256: Request processed in 170us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463192.974345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463192.974465:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004ef8c477 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485646336:0@lo:256: 10000000:01000000:2.0:1788463192.974515:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463192.974523:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463192.974534:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463193.731775:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463193.848197:0:6954:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463193.848513:0:6954:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463194.756494:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463195.014603:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463195.014628:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002afc9b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485646464:0@lo:400: 00000100:00100000:3.0:1788463195.014817:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463195.014949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646464 00000100:00100000:1.0:1788463195.014958:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646464 00000100:00100000:1.0:1788463195.015013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788463195.015021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a345d677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3650:x1875339485646464:12345-0@lo:400: 00000100:00100000:1.0:1788463195.015072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a345d677 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3650:x1875339485646464:12345-0@lo:400: Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463195.015090:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788463195.015131:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002afc9b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485646464:0@lo:400: 00000100:00100000:2.0:1788463195.015364:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091365740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485646592:0@lo:400: 00000100:00100000:2.0:1788463195.015400:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463195.015532:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646592 00000100:00100000:1.0:1788463195.015537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646592 00000100:00100000:1.0:1788463195.015570:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463195.015605:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ef8c477 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485646592:12345-0@lo:400: 00000100:00100000:1.0:1788463195.015638:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ef8c477 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485646592:12345-0@lo:400: Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463195.015644:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788463195.015766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000091365740 x1875339485646592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463195.015778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091365740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485646592:0@lo:400: 00010000:00010000:2.0:1788463195.779736:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463196.810359:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463197.837619:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463198.853029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463199.875710:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463200.131828:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485646848:0@lo:400: 00000100:00100000:1.0:1788463200.131938:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463200.132062:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646848 00000100:00100000:1.0:1788463200.132074:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646848 00000100:00100000:1.0:1788463200.132163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463200.132173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8772137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485646848:12345-0@lo:400: 00000100:00100000:1.0:1788463200.132247:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8772137 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485646848:12345-0@lo:400: Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463200.132256:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788463200.132318:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000345f6a1b x1875339485646848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463200.132336:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485646848:0@lo:400: 00000100:00100000:2.0:1788463200.132645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002afc9b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485646720:0@lo:400: 00000100:00100000:2.0:1788463200.132698:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463200.132905:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646720 00000100:00100000:1.0:1788463200.132912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646720 00000100:00100000:1.0:1788463200.132962:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463200.132969:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f9be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3649:x1875339485646720:12345-0@lo:400: 00000100:00100000:1.0:1788463200.133013:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f9be86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3649:x1875339485646720:12345-0@lo:400: Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463200.133020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463200.133569:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002afc9b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485646720:0@lo:400: 00010000:00010000:3.0:1788463200.900870:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463201.923720:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463202.952464:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463203.973315:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463204.996051:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463205.253295:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485646976:0@lo:400: 00000100:00100000:1.0:1788463205.253389:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463205.253461:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf93ce23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485647104:0@lo:400: 00000100:00100000:1.0:1788463205.253491:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463205.253530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485646976 00000100:00100000:1.0:1788463205.253537:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485646976 00000100:00100000:1.0:1788463205.253604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463205.253612:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a50f717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3651:x1875339485646976:12345-0@lo:400: 00000100:00100000:1.0:1788463205.253665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a50f717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3651:x1875339485646976:12345-0@lo:400: Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463205.253673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463205.253717:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647104 00000100:00100000:1.0:1788463205.253733:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647104 00000100:00100000:1.0:1788463205.253765:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463205.253771:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a478d431 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485647104:12345-0@lo:400: 00000100:00100000:1.0:1788463205.253807:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a478d431 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485647104:12345-0@lo:400: Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463205.253813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788463205.253853:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bf93ce23 x1875339485647104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463205.253867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf93ce23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485647104:0@lo:400: 00000100:00100000:1.0:1788463205.253894:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485646976:0@lo:400: 00000020:01000004:2.0:1788463205.785104:0:7453:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463205.785109:0:7453:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788463205.785110:0:7453:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788463205.785264:0:7453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005e494ac3 00000020:01000004:2.0:1788463205.785285:0:7453:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788463205.785296:0:7453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463205.785309:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000052231722) 00000020:00000080:2.0:1788463205.785326:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788463205.846263:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788463205.846327:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788463205.865364:0:7453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788463205.865695:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788463205.865705:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788463205.865728:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3932f 00000020:01000004:3.0:1788463205.865735:0:7453:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788463205.865754:0:7453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788463205.865757:0:7453:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788463205.865762:0:7453:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788463205.865788:0:7453:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788463205.865792:0:7453:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788463205.881370:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788463205.881412:0:7453:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788463205.881417:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788463205.881419:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463205.881420:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463205.881422:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463205.881423:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463205.881424:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463205.881425:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463205.881427:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463205.881428:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463205.881430:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463205.881432:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463205.881435:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788463205.881442:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463205.881443:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463205.881444:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463205.881445:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463205.881446:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463205.881447:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463205.881448:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463205.881449:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463205.881449:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463205.881450:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463205.881451:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788463205.881476:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788463205.881491:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485647232:0@lo:253: 00000100:00100000:0.0:1788463205.881787:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463205.881879:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000003546072f going to sleep for 11 seconds 00000100:00100000:2.0:1788463205.881896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647232 00000100:00100000:2.0:1788463205.881904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647232 00000100:00100000:2.0:1788463205.881960:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463205.881973:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000227aab8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485647232:12345-0@lo:253: 20000000:01000000:2.0:1788463205.882004:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788463205.882009:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788463205.882014:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788463205.882018:0:6517:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788463205.882051:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788463205.882635:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463205.882779:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788463205.882794:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788463205.882811:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788463205.882990:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788463205.883014:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788463205.883073:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788463205.883081:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788463205.883093:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788463205.883098:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788463205.883109:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788463205.883114:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788463205.883126:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788463205.883140:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788463205.884777:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788463205.884796:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788463205.884812:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788463205.885436:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788463205.885475:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788463205.885483:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:2.0:1788463205.886038:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788463205.886049:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788463205.886069:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788463205.886086:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788463205.886100:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788463205.886350:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788463205.886360:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788463205.886552:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788463205.886595:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788463205.886616:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788463205.886622:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788463205.886635:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788463205.886656:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788463205.886661:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788463205.886682:0:6517:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788463205.886689:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788463205.888067:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788463205.888261:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788463205.888287:0:6517:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.153@tcp for mdt 20000000:01000000:1.0:1788463205.888290:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:1.0:1788463205.888305:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788463205.888311:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788463205.888324:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788463205.888330:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:1.0:1788463205.888345:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788463205.888352:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788463205.888364:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788463205.888379:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788463205.888456:0:6517:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788463205.888465:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788463205.889197:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788463205.889380:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788463205.889400:0:6517:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.153@tcp for mdt 20000000:01000000:0.0:1788463205.889402:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:0.0:1788463205.889419:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788463205.889425:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788463205.889439:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788463205.889444:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:0.0:1788463205.889457:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788463205.889463:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788463205.889474:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788463205.889487:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788463205.889507:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788463205.889522:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788463205.889525:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788463205.889622:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788463205.889624:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463205.899855:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463205.899910:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463205.899930:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788463205.900086:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788463205.900111:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788463205.900141:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788463205.900154:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788463205.900156:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463205.900853:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463205.900879:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463205.900894:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788463205.901051:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788463205.901088:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788463205.901107:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788463205.901118:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788463205.901120:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463205.901961:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463205.901987:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463205.902015:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788463205.902143:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788463205.902163:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788463205.902200:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788463205.902226:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788463205.902229:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788463205.902234:0:6517:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788463205.902240:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788463205.908327:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788463205.908500:0:6517:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788463205.928694:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788463205.928776:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928797:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39264 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928832:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39280 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928838:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928844:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928887:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.928901:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 12 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.928915:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647360:0@lo:104: 00000100:00100000:1.0:1788463205.928981:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463205.929047:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.929055:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 12 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.929063:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647488:0@lo:104: 00000100:00100000:2.0:1788463205.929064:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647360 00000100:00100000:2.0:1788463205.929071:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647360 00000100:00100000:1.0:1788463205.929083:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463205.929106:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647488 00000100:00100000:2.0:1788463205.929109:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647488 00010000:00010000:1.0:1788463205.929114:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.929121:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 12 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463205.929122:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463205.929128:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf93ce23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6517:x1875339485647360:12345-0@lo:104: 00000100:00100000:1.0:1788463205.929135:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647616:0@lo:104: 00010000:00010000:2.0:1788463205.929139:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.929156:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463205.929165:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051dd15ed going to sleep for 11 seconds 00010000:00010000:2.0:1788463205.929192:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463205.929193:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647360:0@lo:104: 00000100:00100000:2.0:1788463205.929197:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf93ce23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6517:x1875339485647360:12345-0@lo:104: Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463205.929222:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463205.929239:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647616 00000100:00100000:2.0:1788463205.929243:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647616 00000100:00100000:2.0:1788463205.929256:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463205.929260:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fecccf79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6517:x1875339485647488:12345-0@lo:104: 00010000:00010000:2.0:1788463205.929268:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.929313:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463205.929318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fecccf79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6517:x1875339485647488:12345-0@lo:104: Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463205.929323:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463205.929334:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463205.929340:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b611223f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6517:x1875339485647616:12345-0@lo:104: 00010000:00010000:2.0:1788463205.929346:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.929370:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788463205.929374:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b611223f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6517:x1875339485647616:12345-0@lo:104: Request processed in 35us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463205.929378:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788463205.929410:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463205.929416:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929433:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a375499 already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463205.929436:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929444:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463205.929450:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463205.929456:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463205.929497:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929504:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463205.929524:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929530:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 000000007a375499/0x841acb7f42a392f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392f7 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929541:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463205.929543:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929549:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc77e8b3 already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463205.929550:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929568:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463205.929599:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463205.929605:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463205.929619:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929624:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463205.929638:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929645:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 00000000cc77e8b3/0x841acb7f42a39280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39287 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929659:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463205.929661:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929666:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009df2a462 already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463205.929668:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929673:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463205.929678:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.929687:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647488:0@lo:104: 10000000:01000000:3.0:1788463205.929689:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788463205.929694:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875339485647616:0@lo:104: 00010000:00010000:3.0:1788463205.929722:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.929725:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929727:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463205.929732:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929737:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a39264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3926b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929749:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463205.929751:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463205.929752:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463205.929759:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463205.929769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb63add9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485647744:0@lo:103: 00000100:00100000:3.0:1788463205.929800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463205.929857:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1327662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485647872:0@lo:103: 00000100:00100000:1.0:1788463205.929871:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647744 00000100:00100000:1.0:1788463205.929875:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647744 00000100:00100000:3.0:1788463205.929880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463205.929892:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 13 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463205.929898:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463205.929902:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062df33bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485648000:0@lo:103: 00000100:00100000:1.0:1788463205.929910:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485647872 00000100:00100000:1.0:1788463205.929912:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485647872 00000100:00100000:3.0:1788463205.929920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463205.929921:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 14 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.929944:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648000 00000100:00100000:3.0:1788463205.929947:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463205.929947:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648000 00000100:00100000:3.0:1788463205.929954:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e7d0e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3649:x1875339485647744:12345-0@lo:103: 00010000:00010000:1.0:1788463205.929956:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 15 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929963:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788463205.929966:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788463205.929967:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.929971:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a40d41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3650:x1875339485647872:12345-0@lo:103: 00010000:00010000:1.0:1788463205.929976:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463205.929983:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 15 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.929985:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.929992:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 15 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.930326:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065dee744/0x841acb7f42a392f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a392f0 expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.930339:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463205.930378:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e7d0e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3649:x1875339485647744:12345-0@lo:103: Request processed in 426us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.930385:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463205.930402:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463205.930408:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aef6fd25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:3650:x1875339485648000:12345-0@lo:103: 00010000:00010000:3.0:1788463205.930416:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463205.930420:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 13 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.930428:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 13 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.930437:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000008dfd03/0x841acb7f42a3926b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39264 expref: 13 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.930445:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463205.930477:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aef6fd25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3650:x1875339485648000:12345-0@lo:103: Request processed in 70us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.930483:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463205.930601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062df33bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485648000:0@lo:103: 00000100:00100000:2.0:1788463205.930667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb63add9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485647744:0@lo:103: 00010000:00010000:1.0:1788463205.931363:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000039b1622d/0x841acb7f42a39287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39280 expref: 11 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934098:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934117:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934150:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934157:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934163:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934169:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934175:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c08e155b already unused, calling callback (00000000c265efd7) 00010000:00010000:1.0:1788463205.934179:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934187:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934492:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.934506:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463205.934615:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a40d41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:3650:x1875339485647872:12345-0@lo:103: Request processed in 4640us (4730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463205.934626:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463205.934747:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1327662 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485647872:0@lo:103: 00010000:00010000:3.0:1788463205.935102:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.935125:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.935132:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c08e155b/0x841acb7f42a39336 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463205.935155:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788463205.945108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000227aab8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:7453:x1875339485647232:12345-0@lo:253: Request processed in 63128us (63313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.945124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463205.945259:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485647232:0@lo:253: 10000000:01000000:0.0:1788463205.945275:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788463205.945278:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463205.945280:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463205.945282:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463205.945283:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788463205.945284:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463205.945286:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463205.945287:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463205.945288:0:7453:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788463205.945303:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463205.945304:0:7453:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788463205.945323:0:7453:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e494ac3 from lustre-MDT0001 10000000:01000000:0.0:1788463205.945353:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788463205.945356:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788463205.945362:0:7453:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff961884ff19c0 local copy 10000000:01000000:0.0:1788463205.945365:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788463205.945465:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.945475:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.945483:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463205.945499:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648128:0@lo:101: 00000100:00100000:0.0:1788463205.945537:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463205.945622:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a4a1976 going to sleep for 11 seconds 00000100:00100000:1.0:1788463205.945703:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648128 00000100:00100000:1.0:1788463205.945721:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648128 00000100:00100000:1.0:1788463205.945769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463205.945778:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064d3c265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:7453:x1875339485648128:12345-0@lo:101: 00010000:00010000:1.0:1788463205.945790:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463205.945804:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000006903212/0x841acb7f42a39344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3933d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.945840:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000006903212/0x841acb7f42a39344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3933d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.945851:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000006903212/0x841acb7f42a39344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3933d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.945861:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000006903212, rc 0) 00000100:00100000:1.0:1788463205.945900:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064d3c265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:7453:x1875339485648128:12345-0@lo:101: Request processed in 123us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463205.945905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463205.946035:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648128:0@lo:101: 00010000:00010000:0.0:1788463205.946047:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946055:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463205.946140:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648256:0@lo:501: 00000100:00100000:0.0:1788463205.946170:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463205.946199:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a4a1976 going to sleep for 11 seconds 00000100:00100000:1.0:1788463205.946250:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648256 00000100:00100000:1.0:1788463205.946255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648256 00000100:00100000:1.0:1788463205.946289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788463205.946306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b67d491f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:7453:x1875339485648256:12345-0@lo:501: 00000100:00100000:1.0:1788463205.946363:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b67d491f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:7453:x1875339485648256:12345-0@lo:501: Request processed in 59us (193us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463205.946444:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463205.946676:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648256:0@lo:501: 10000000:01000000:0.0:1788463205.946694:0:7453:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788463205.946723:0:7453:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788463205.946727:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946735:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946741:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946761:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463205.946779:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96188d0ea000 10000000:01000000:0.0:1788463205.946784:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788463205.946789:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff961884ff19c0 10000000:01000000:0.0:1788463205.946791:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788463205.946794:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff961884ff19c0 from 1 10000000:01000000:0.0:1788463205.946796:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788463205.946869:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946877:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.946884:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463205.946897:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648384:0@lo:101: 00000100:00100000:0.0:1788463205.946924:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463205.946954:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ec934a3 going to sleep for 11 seconds 00000100:00100000:1.0:1788463205.947014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648384 00000100:00100000:1.0:1788463205.947019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648384 00000100:00100000:1.0:1788463205.947051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463205.947057:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e1ba047 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+10:7453:x1875339485648384:12345-0@lo:101: 00010000:00010000:1.0:1788463205.947064:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463205.947074:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039828a0b/0x841acb7f42a39352 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3934b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.947087:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039828a0b/0x841acb7f42a39352 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3934b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.947095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039828a0b/0x841acb7f42a39352 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3934b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.947101:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039828a0b, rc 0) 00000100:00100000:1.0:1788463205.947141:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e1ba047 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:7453:x1875339485648384:12345-0@lo:101: Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463205.947147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463205.947218:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000678ae9e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648384:0@lo:101: 00010000:00010000:2.0:1788463205.947229:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.947247:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463205.947263:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788463205.947278:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.947284:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000001105b459/0x841acb7f42a3934b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463205.947291:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96188d0ea000 10000000:01000000:2.0:1788463205.947295:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788463205.947298:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96188d0ea000 from 1 10000000:01000000:2.0:1788463205.947300:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788463205.947315:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.947320:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.947326:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463205.947337:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648512:0@lo:101: 00000100:00100000:2.0:1788463205.947363:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463205.947488:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e63ca968 going to sleep for 11 seconds 00000100:00100000:0.0:1788463205.947548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648512 00000100:00100000:0.0:1788463205.947553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648512 00000100:00100000:0.0:1788463205.947605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463205.947613:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000113ef397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:7453:x1875339485648512:12345-0@lo:101: 00010000:00010000:0.0:1788463205.947619:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463205.947626:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000dd6490c/0x841acb7f42a39360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39359 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.947639:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000dd6490c/0x841acb7f42a39360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39359 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.947647:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000dd6490c/0x841acb7f42a39360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39359 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.947653:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000dd6490c, rc 0) 00000100:00100000:0.0:1788463205.947690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000113ef397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485648512:12345-0@lo:101: Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463205.947695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788463205.947791:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463205.947796:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.947803:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030ecab7a already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463205.947806:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.947823:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463205.947830:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463205.947835:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463205.947855:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.947861:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463205.947888:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.947894:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 0000000030ecab7a/0x841acb7f42a3933d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a39344 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.947910:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463205.947912:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463205.947913:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463205.947920:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463205.947930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9ca3c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485648640:0@lo:103: 00000100:00100000:3.0:1788463205.947960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463205.947992:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648640 00000100:00100000:3.0:1788463205.947996:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648640 00000100:00100000:3.0:1788463205.948026:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463205.948032:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40dbe11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:3649:x1875339485648640:12345-0@lo:103: 00010000:00010000:3.0:1788463205.948040:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463205.948051:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000006903212/0x841acb7f42a39344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a3933d expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463205.948062:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463205.948088:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40dbe11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:3649:x1875339485648640:12345-0@lo:103: Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.948093:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463205.948122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9ca3c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485648640:0@lo:103: 00000100:00100000:2.0:1788463205.948269:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648512:0@lo:101: 00010000:00010000:2.0:1788463205.948287:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.948299:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463205.948311:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788463205.948326:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.948333:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000cdcc9dd4/0x841acb7f42a39359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463205.948340:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788463205.948344:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463205.948349:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96188d0ea000 10000000:01000000:2.0:1788463205.948352:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788463205.948355:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788463205.948357:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788463205.949666:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.949682:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463205.949693:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463205.949729:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648768:0@lo:101: 00000100:00100000:2.0:1788463205.949787:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463205.949908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648768 00000100:00100000:0.0:1788463205.949916:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648768 00000100:00100000:2.0:1788463205.950060:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e63ca968 going to sleep for 11 seconds 00000100:00100000:0.0:1788463205.951289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463205.951304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b785308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+11:7453:x1875339485648768:12345-0@lo:101: 00010000:00010000:0.0:1788463205.951322:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463205.951339:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042debcb8/0x841acb7f42a3936e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39367 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.951364:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042debcb8/0x841acb7f42a3936e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39367 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.951403:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042debcb8/0x841acb7f42a3936e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39367 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463205.951411:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042debcb8, rc 0) 00000100:00100000:0.0:1788463205.951477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b785308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485648768:12345-0@lo:101: Request processed in 180us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463205.951484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463205.958640:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648768:0@lo:101: 00010000:00010000:1.0:1788463205.958673:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463205.958687:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463205.959257:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648896:0@lo:501: 00000100:00100000:1.0:1788463205.959323:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463205.959513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485648896 00000100:00100000:3.0:1788463205.959521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485648896 00000100:00100000:3.0:1788463205.959564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463205.959572:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b8b279a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485648896:12345-0@lo:501: 00000100:00100000:3.0:1788463205.959765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b8b279a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485648896:12345-0@lo:501: Request processed in 194us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.959774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788463205.960420:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d90395ac going to sleep for 11 seconds 00000100:00100000:1.0:1788463205.960445:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485648896:0@lo:501: 00000100:00100000:1.0:1788463205.960486:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649024:0@lo:503: 00000100:00100000:1.0:1788463205.960541:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463205.960724:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649024 00000100:00100000:2.0:1788463205.960731:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649024 00000100:00100000:2.0:1788463205.960780:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463205.960788:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a7a24c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649024:12345-0@lo:503: 00000100:00100000:2.0:1788463205.960890:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a7a24c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649024:12345-0@lo:503: Request processed in 103us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463205.960897:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463205.964616:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d90395ac going to sleep for 11 seconds 00000100:00100000:1.0:1788463205.964670:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649024:0@lo:503: 00000040:00080000:1.0:1788463205.965123:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463205.965219:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649152:0@lo:502: 00000100:00100000:1.0:1788463205.965292:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463205.965532:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d90395ac going to sleep for 11 seconds 00000100:00100000:2.0:1788463205.968910:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649152 00000100:00100000:2.0:1788463205.968927:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649152 00000100:00100000:2.0:1788463205.969056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463205.969067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008be9499b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649152:12345-0@lo:502: 00000100:00100000:2.0:1788463205.969269:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008be9499b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649152:12345-0@lo:502: Request processed in 204us (3977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463205.969276:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463205.969405:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649152:0@lo:502: 00000040:00080000:1.0:1788463205.969725:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788463205.969756:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788463205.969770:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788463205.969783:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788463205.969795:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788463205.969810:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788463205.969838:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788463205.969851:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788463205.969862:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788463205.969875:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788463205.969889:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788463205.969900:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788463205.969912:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788463205.969936:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788463205.969950:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788463205.969980:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788463205.969995:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788463205.970007:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788463205.970018:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788463205.970028:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788463205.970039:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788463205.970050:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788463205.970063:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788463205.970094:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649280:0@lo:502: 00000100:00100000:1.0:1788463205.970146:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463205.976158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649280 00000100:00100000:3.0:1788463205.976174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649280 00000100:00100000:3.0:1788463205.976240:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463205.976248:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fdc94a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649280:12345-0@lo:502: 00000100:00100000:0.0:1788463205.981400:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d90395ac going to sleep for 11 seconds 00000100:00100000:3.0:1788463205.981852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fdc94a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649280:12345-0@lo:502: Request processed in 5599us (11700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463205.981865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788463205.982301:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649280:0@lo:502: 00000040:00080000:0.0:1788463205.982408:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788463205.982424:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788463205.996500:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463205.996516:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463205.996518:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788463205.996526:0:7465:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788463205.996529:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463205.996589:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000b8ba870b) 00000020:00000080:2.0:1788463205.996613:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788463205.996621:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788463205.996722:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463205.996731:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3937c 00000020:00000080:2.0:1788463205.996999:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788463205.997003:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463205.997007:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463205.997008:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788463205.997011:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463205.997014:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463205.997022:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788463205.997025:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463205.997032:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000793fb245) 00000020:00000080:2.0:1788463205.997044:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788463205.997048:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788463205.997050:0:7465:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788463205.997053:0:7465:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788463205.997059:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463205.997113:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e494ac3 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788463205.997125:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000037f19a94) 00000020:00000080:2.0:1788463205.997133:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788463205.997204:0:7465:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788463205.997209:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a39391 00000020:00000080:2.0:1788463205.997309:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788463205.997316:0:7465:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788463205.997321:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x841acb7f42a39398 00080000:01000000:2.0:1788463205.997326:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788463205.997330:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3939f 00080000:10000000:2.0:1788463205.998262:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788463205.998401:0:7465:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788463206.020604:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463206.139838:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788463206.140898:0:7465:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788463206.151838:0:7465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788463206.152193:0:7465:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788463206.170873:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788463206.170889:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463206.170895:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463206.170897:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788463206.170901:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463206.170907:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463206.170908:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788463206.170911:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463206.170916:0:7465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:1.0:1788463206.170944:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463206.170958:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000893f330e) 00000020:00000080:1.0:1788463206.170979:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788463206.170985:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463206.171086:0:7465:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788463206.171102:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788463206.171109:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a393ad 00010000:00080000:1.0:1788463206.171139:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004be48c0b@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463206.177296:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788463206.178911:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463206.178925:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788463206.178960:0:7465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788463206.178979:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a393b4 00000100:00080000:0.0:1788463206.178990:0:7465:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463206.179008:0:7465:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004be48c0b using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463206.179045:0:7465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a495bddd x1875339485649408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463206.179066:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788463206.179127:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463206.179131:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179133:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788463206.179135:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788463206.179138:0:7465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788463206.179140:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463206.179141:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463206.179142:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788463206.179152:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179153:0:7465:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788463206.179157:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463206.179161:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179162:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788463206.179166:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788463206.179200:0:7465:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788463206.179213:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463206.179216:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179217:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788463206.179219:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463206.179221:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179223:0:7465:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463206.179225:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463206.179226:0:7465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463206.179249:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463206.179252:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463206.179253:0:7465:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463206.179255:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788463206.179661:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a495bddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485649408:0@lo:38: 00000100:00100000:2.0:1788463206.179749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.179891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485649536:0@lo:400: 00000100:00100000:2.0:1788463206.179922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788463206.179958:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788463206.179988:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788463206.180010:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180020:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000002ad67f47/0x841acb7f42a39367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463206.180042:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188d0ea000 from 1 10000000:01000000:2.0:1788463206.180046:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463206.180071:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180078:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180089:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.180112:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649664:0@lo:101: 00000100:00100000:2.0:1788463206.180142:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.180158:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000000579f7d1 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.180177:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649664 00000100:00100000:2.0:1788463206.180184:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649664 00000100:00100000:2.0:1788463206.180224:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463206.180231:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000712497f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+12:7453:x1875339485649664:12345-0@lo:101: 00010000:00010000:2.0:1788463206.180246:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463206.180256:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a393bb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180276:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a393bb expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180285:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393bb expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180294:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1ac8b57, rc 0) 00000100:00100000:2.0:1788463206.180350:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000712497f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:7453:x1875339485649664:12345-0@lo:101: Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.180357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463206.180403:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649664:0@lo:101: 00010000:00010000:2.0:1788463206.180416:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.180425:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.181020:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649792:0@lo:256: 00000100:00100000:2.0:1788463206.181061:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.181088:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044b789f7 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.181118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649792 00000100:00100000:2.0:1788463206.181123:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649792 00000100:00100000:2.0:1788463206.181150:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463206.181156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000249a5b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:7453:x1875339485649792:12345-0@lo:256: 20000000:01000000:2.0:1788463206.181170:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788463206.181857:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788463206.181862:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788463206.181965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000249a5b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:7453:x1875339485649792:12345-0@lo:256: Request processed in 808us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.181973:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463206.182021:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649792:0@lo:256: 00000100:00100000:1.0:1788463206.182608:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649408 00000100:00100000:1.0:1788463206.182620:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649408 00000100:00100000:1.0:1788463206.182649:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463206.182654:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c91b33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485649408:12345-0@lo:38: 00010000:00080000:1.0:1788463206.182675:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788463206.182725:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a393c9 00000004:00100000:1.0:1788463206.182739:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788463206.182744:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788463206.182813:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649536 00000100:00100000:1.0:1788463206.182817:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649536 00000100:00100000:1.0:1788463206.182842:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463206.182848:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c762d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485649536:12345-0@lo:400: 00000100:00100000:1.0:1788463206.182895:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c762d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485649536:12345-0@lo:400: Request processed in 48us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463206.182902:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463206.182948:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fc7d25ac x1875339485649536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463206.182962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485649536:0@lo:400: 10000000:01000000:2.0:1788463206.184056:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463206.184082:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.184227:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463206.184235:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188d0ea000 from 1 10000000:01000000:2.0:1788463206.184237:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463206.184272:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.184279:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.184287:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.184307:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649920:0@lo:101: 00000100:00100000:2.0:1788463206.184358:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.184399:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044b789f7 going to sleep for 11 seconds 00000100:00100000:0.0:1788463206.184561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485649920 00000100:00100000:0.0:1788463206.184568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485649920 00000100:00100000:0.0:1788463206.184635:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788463206.184643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a96e05bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:7453:x1875339485649920:12345-0@lo:101: 00010000:00010000:0.0:1788463206.184654:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463206.184665:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a393d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463206.184687:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463206.184697:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463206.184728:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030ecab7a, rc 0) 00000100:00100000:0.0:1788463206.184764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a96e05bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485649920:12345-0@lo:101: Request processed in 122us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463206.184772:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788463206.185482:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485649920:0@lo:101: 00010000:00010000:2.0:1788463206.185500:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.185508:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.185658:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650048:0@lo:501: 00000100:00100000:2.0:1788463206.185692:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.185730:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000044b789f7 going to sleep for 11 seconds 00000100:00100000:0.0:1788463206.186816:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650048 00000100:00100000:0.0:1788463206.186825:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650048 00000100:00100000:0.0:1788463206.186877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463206.186885:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001387e0e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485650048:12345-0@lo:501: 00000100:00100000:0.0:1788463206.187039:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001387e0e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485650048:12345-0@lo:501: Request processed in 154us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463206.187046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463206.187296:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650048:0@lo:501: 00000100:00100000:1.0:1788463206.187342:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650176:0@lo:503: 00000100:00100000:1.0:1788463206.187391:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463206.187426:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e9adbae going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.187477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650176 00000100:00100000:2.0:1788463206.187482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650176 00000100:00100000:2.0:1788463206.187530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463206.187537:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac582b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485650176:12345-0@lo:503: 00000040:00080000:2.0:1788463206.187599:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463206.187640:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac582b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485650176:12345-0@lo:503: Request processed in 104us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.187647:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463206.187841:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650176:0@lo:503: 00000040:00080000:1.0:1788463206.188236:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463206.188299:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788463206.188379:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463206.189776:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000100:00080000:1.0:1788463206.193532:0:6527:0:(import.c:65:import_set_state_nolock()) 0000000012529f58 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463206.193660:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c91b33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485649408:12345-0@lo:38: Request processed in 11002us (13909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463206.193671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463206.193774:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463206.193784:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788463206.193791:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788463206.193797:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463206.193799:0:3647:0:(import.c:65:import_set_state_nolock()) 000000004be48c0b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463206.193816:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a495bddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485649408:0@lo:38: 00000100:00100000:0.0:1788463206.193913:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485650304:0@lo:41: 00000100:00100000:0.0:1788463206.193953:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.194233:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650304 00000100:00100000:3.0:1788463206.194241:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650304 00000100:00100000:3.0:1788463206.194284:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463206.194291:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a495bddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485650304:12345-0@lo:41: 00000004:00000024:3.0:1788463206.194317:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000020:01000000:2.0:1788463206.194446:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788463206.194493:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463206.194512:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194523:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463206.194571:0:7453:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463206.194593:0:7453:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96188d0ea000 10000000:01000000:2.0:1788463206.194596:0:7453:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96188d0ea000 10000000:01000000:2.0:1788463206.194601:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463206.194608:0:7453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188d0ea000 from 1 10000000:01000000:2.0:1788463206.194611:0:7453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463206.194640:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194648:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194657:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.194687:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650432:0@lo:101: 00000100:00100000:2.0:1788463206.194733:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.194763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650432 00000100:00100000:2.0:1788463206.194767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650432 00000100:00100000:2.0:1788463206.194796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463206.194802:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070529acf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:7453:x1875339485650432:12345-0@lo:101: 00010000:00010000:2.0:1788463206.194812:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463206.194822:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c29b72fd/0x841acb7f42a393e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a393de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194843:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c29b72fd/0x841acb7f42a393e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a393de expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194853:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c29b72fd/0x841acb7f42a393e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393de expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194863:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c29b72fd, rc 0) 00000100:00100000:2.0:1788463206.194888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070529acf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650432:12345-0@lo:101: Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.194894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463206.194924:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.194941:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650432:0@lo:101: 00010000:00010000:2.0:1788463206.194953:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.194961:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.195070:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650560:0@lo:501: 00000100:00100000:2.0:1788463206.195266:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.195303:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788463206.195364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650560 00000100:00100000:1.0:1788463206.195369:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650560 00000100:00100000:1.0:1788463206.195404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463206.195411:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c00f4d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650560:12345-0@lo:501: 00000100:00100000:1.0:1788463206.195506:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c00f4d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650560:12345-0@lo:501: Request processed in 95us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463206.195513:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463206.195769:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650560:0@lo:501: 00000100:00100000:2.0:1788463206.195798:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650688:0@lo:503: 00000100:00100000:2.0:1788463206.195835:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.195853:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.195865:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650688 00000100:00100000:2.0:1788463206.195868:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650688 00000100:00100000:2.0:1788463206.195892:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463206.195898:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047a17006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650688:12345-0@lo:503: 00000100:00100000:2.0:1788463206.195977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047a17006 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650688:12345-0@lo:503: Request processed in 78us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.195983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463206.196043:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650688:0@lo:503: 00000040:00080000:2.0:1788463206.198088:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463206.198333:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650816:0@lo:502: 00000100:00100000:2.0:1788463206.198410:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.198505:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000100:00100000:3.0:1788463206.198870:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a495bddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485650304:12345-0@lo:41: Request processed in 4577us (4914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.198881:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463206.199214:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa49301c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485650304:0@lo:41: 00000100:00100000:1.0:1788463206.200190:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650816 00000100:00100000:1.0:1788463206.200201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650816 00000100:00100000:1.0:1788463206.200294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463206.200303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fbc3421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650816:12345-0@lo:502: 00000100:00100000:1.0:1788463206.200469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fbc3421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650816:12345-0@lo:502: Request processed in 167us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463206.200477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463206.200555:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650816:0@lo:502: 00000040:00080000:0.0:1788463206.200848:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788463206.200878:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788463206.200892:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788463206.200907:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788463206.200919:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788463206.200943:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788463206.200956:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788463206.200970:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788463206.200984:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788463206.201016:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788463206.201031:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788463206.201044:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788463206.201056:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788463206.201071:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788463206.201083:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788463206.201107:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788463206.201123:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788463206.201137:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788463206.201148:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788463206.201159:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788463206.201170:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788463206.201181:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788463206.201193:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788463206.201205:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788463206.201218:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788463206.201231:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788463206.201243:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788463206.201255:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788463206.201290:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca457c6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650944:0@lo:502: 00000100:00100000:0.0:1788463206.201346:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463206.202019:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff45fd53 going to sleep for 11 seconds 00000100:00100000:3.0:1788463206.202211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485650944 00000100:00100000:3.0:1788463206.202220:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485650944 00000100:00100000:3.0:1788463206.202258:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463206.202265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e79fe466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650944:12345-0@lo:502: 00000100:00100000:3.0:1788463206.202425:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e79fe466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485650944:12345-0@lo:502: Request processed in 159us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.202439:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463206.202554:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca457c6b pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485650944:0@lo:502: 00000040:00080000:0.0:1788463206.202741:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788463206.202753:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788463206.208446:0:7471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788463206.208470:0:7471:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c9a36c55) 00000020:00000080:3.0:1788463206.208492:0:7471:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788463206.208569:0:7471:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e494ac3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788463206.208769:0:7471:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005e494ac3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788463206.208772:0:7471:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005e494ac3 3 00010000:00080000:3.0:1788463206.208801:0:7471:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fb286e71@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463206.211187:0:7471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788463206.211456:0:7471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788463206.211497:0:7471:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463206.211511:0:7471:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x841acb7f42a393f3 00000100:00080000:3.0:1788463206.211522:0:7471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463206.211527:0:7471:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000fb286e71 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463206.211566:0:7471:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e9ca3c84 x1875339485651072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463206.211618:0:7471:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788463206.211799:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:3.0:1788463206.211915:0:7472:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788463206.212132:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9ca3c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485651072:0@lo:38: 00000100:00100000:0.0:1788463206.212206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788463206.212279:0:7453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788463206.212312:0:7453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463206.212329:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463206.212339:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000ee8abd51/0x841acb7f42a393de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788463206.212396:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788463206.212399:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463206.212400:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463206.212401:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463206.212402:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463206.212403:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463206.212405:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463206.212406:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463206.212407:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463206.212409:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463206.212410:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463206.212413:0:7453:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788463206.212416:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463206.212417:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788463206.212418:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463206.212420:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463206.212421:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463206.212422:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463206.212423:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463206.212424:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463206.212425:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463206.212426:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463206.212427:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463206.212444:0:7453:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788463206.212455:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003e832d65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485651200:0@lo:253: 00000100:00100000:0.0:1788463206.212489:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463206.212517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651200 00000100:00100000:0.0:1788463206.212525:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651200 00000100:00100000:0.0:1788463206.212570:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463206.212598:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095af2b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7453:x1875339485651200:12345-0@lo:253: 20000000:01000000:0.0:1788463206.212624:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788463206.212638:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788463206.212935:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff45fd53 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.213022:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651072 00000100:00100000:2.0:1788463206.213027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651072 00000100:00100000:2.0:1788463206.213056:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463206.213061:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca457c6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485651072:12345-0@lo:38: 00010000:00080000:2.0:1788463206.213086:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1788463206.213116:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x841acb7f42a393fa 00000004:00100000:2.0:1788463206.213131:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463206.213160:0:6522:0:(import.c:65:import_set_state_nolock()) 000000006902797c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463206.213212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca457c6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875339485651072:12345-0@lo:38: Request processed in 149us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.213219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788463206.213961:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e9ca3c84 x1875339485651072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463206.213973:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463206.213980:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788463206.213986:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788463206.213990:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463206.214052:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000fb286e71 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463206.214060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9ca3c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485651072:0@lo:38: 00000001:00100000:3.0:1788463206.214854:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788463206.214914:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463206.214930:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788463206.215143:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463206.215148:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463206.215169:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215186:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3931a expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215192:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215198:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215233:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215247:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.215260:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f21c9b2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485651328:0@lo:104: 00000100:00100000:2.0:1788463206.215319:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463206.215386:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463206.215394:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463206.215402:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485651456:0@lo:104: 00000100:00100000:2.0:1788463206.215422:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.215441:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3d243b6 going to sleep for 11 seconds 00000100:00100000:3.0:1788463206.215671:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651328 00000100:00100000:3.0:1788463206.215679:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651328 00000100:00100000:3.0:1788463206.215720:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651456 00000100:00100000:3.0:1788463206.215724:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651456 00000100:00100000:3.0:1788463206.215738:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463206.215745:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a71f8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485651328:12345-0@lo:104: 00010000:00010000:3.0:1788463206.215758:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.215826:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463206.215832:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a71f8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485651328:12345-0@lo:104: Request processed in 87us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.215839:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463206.215855:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463206.215860:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009372c7f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485651456:12345-0@lo:104: 00010000:00010000:3.0:1788463206.215867:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.215899:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463206.215903:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009372c7f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485651456:12345-0@lo:104: Request processed in 44us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.215908:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788463206.215924:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463206.215929:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.215936:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000551d17f8 already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463206.215939:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.215946:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463206.215952:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463206.215957:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788463206.216088:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f21c9b2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485651328:0@lo:104: 00000100:00100000:2.0:1788463206.216098:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485651456:0@lo:104: 00010000:00010000:2.0:1788463206.216115:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216198:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216205:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463206.216233:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216239:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 00000000551d17f8/0x841acb7f42a393bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393c2 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216251:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463206.216253:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216259:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c98129dd already unused, calling callback (0000000029e2dd3c) 10000000:00010000:3.0:1788463206.216261:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216266:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463206.216271:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463206.216276:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463206.216288:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216294:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463206.216307:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216322:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 00000000c98129dd/0x841acb7f42a3931a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39321 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216336:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463206.216338:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463206.216339:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463206.216345:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463206.216357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014174329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485651712:0@lo:103: 00000100:00100000:3.0:1788463206.216388:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.216431:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651712 00000100:00100000:3.0:1788463206.216435:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651712 00010000:00010000:3.0:1788463206.216450:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 16 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463206.216472:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463206.216478:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c50a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3648:x1875339485651712:12345-0@lo:103: 00010000:00010000:3.0:1788463206.216488:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463206.216492:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 16 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216500:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 16 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216512:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008cb26c51/0x841acb7f42a39321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3931a expref: 16 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216522:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463206.216546:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c50a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3648:x1875339485651712:12345-0@lo:103: Request processed in 69us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.216558:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463206.216611:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014174329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485651712:0@lo:103: 00000100:00100000:3.0:1788463206.216624:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463206.216631:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485651584:0@lo:103: 00000100:00100000:3.0:1788463206.216657:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.216681:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651584 00000100:00100000:3.0:1788463206.216684:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651584 00010000:00010000:3.0:1788463206.216696:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463206.216728:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463206.216734:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ccb1486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3650:x1875339485651584:12345-0@lo:103: 00010000:00010000:3.0:1788463206.216741:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463206.216744:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216753:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216763:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1ac8b57/0x841acb7f42a393c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a393bb expref: 15 pid: 6518 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216773:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216779:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463206.216792:0:6552:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001644999s 00010000:00010000:3.0:1788463206.216801:0:6552:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216808:0:6552:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216814:0:6552:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216819:0:6552:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216825:0:6552:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000da8e5ebf already unused, calling callback (00000000c265efd7) 00010000:00010000:3.0:1788463206.216827:0:6552:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216834:0:6552:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216848:0:6552:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216857:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463206.216883:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ccb1486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3650:x1875339485651584:12345-0@lo:103: Request processed in 149us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.216889:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788463206.216926:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216933:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463206.216948:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39401 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463206.216974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485651584:0@lo:103: 00000100:00100000:0.0:1788463206.217169:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095af2b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:7453:x1875339485651200:12345-0@lo:253: Request processed in 4573us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463206.217177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463206.218896:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003e832d65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:7453:1875339485651200:0@lo:253: 10000000:01000000:3.0:1788463206.218915:0:7453:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788463206.218919:0:7453:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463206.218921:0:7453:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788463206.218922:0:7453:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463206.218924:0:7453:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463206.218925:0:7453:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463206.218926:0:7453:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463206.218927:0:7453:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463206.218929:0:7453:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463206.218930:0:7453:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463206.218931:0:7453:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463206.218933:0:7453:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788463206.218949:0:7453:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788463206.227072:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.227410:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788463206.227661:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.227854:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788463206.228046:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.228494:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788463206.229550:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.229813:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788463206.230008:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.230362:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788463206.230727:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788463206.231433:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788463206.233199:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788463206.233472:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788463206.233521:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875339485651840:0@lo:700: 00000100:00100000:3.0:1788463206.233613:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.233668:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f84937c going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.233755:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651840 00000100:00100000:2.0:1788463206.233764:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651840 00000100:00100000:2.0:1788463206.233816:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463206.233824:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e7d0e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1875339485651840:12345-0@lo:700: 00000040:01000000:0.0:1788463206.234103:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000020:00080000:1.0:1788463206.234295:0:7476:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788463206.234300:0:7476:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788463206.234554:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485651968:0@lo:1000: 00000100:00100000:2.0:1788463206.234638:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.234677:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788463206.234783:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485651968 00000100:00100000:1.0:1788463206.234789:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485651968 00000100:00100000:1.0:1788463206.234829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463206.234837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f21c9b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485651968:12345-0@lo:1000: 00000100:00100000:1.0:1788463206.234917:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f21c9b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485651968:12345-0@lo:1000: Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463206.234925:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463206.235040:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485651968:0@lo:1000: 00000040:01000000:2.0:1788463206.235074:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788463206.235097:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652096:0@lo:700: 00000100:00100000:2.0:1788463206.235123:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.235146:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dce9b6d going to sleep for 11 seconds 00000100:00100000:3.0:1788463206.235202:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652096 00000100:00100000:3.0:1788463206.235207:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652096 00000100:00100000:3.0:1788463206.235237:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463206.235242:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c68be74f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652096:12345-0@lo:700: 00000100:00100000:3.0:1788463206.235287:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c68be74f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652096:12345-0@lo:700: Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.235294:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463206.235715:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652096:0@lo:700: 00000100:00100000:1.0:1788463206.235773:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875339485652224:0@lo:900: 00000100:00100000:1.0:1788463206.235803:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463206.235828:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000258ccd71 going to sleep for 11 seconds 00000100:00100000:2.0:1788463206.235969:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652224 00000100:00100000:2.0:1788463206.235974:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652224 00000100:00100000:2.0:1788463206.236023:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463206.236029:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000397740b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1875339485652224:12345-0@lo:900: 00000100:00100000:2.0:1788463206.236075:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000397740b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1875339485652224:12345-0@lo:900: Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.236081:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788463206.236139:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000345f6a1b x1875339485652224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463206.236149:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000345f6a1b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875339485652224:0@lo:900: 00000100:00100000:3.0:1788463206.236233:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652352:0@lo:1000: 00000100:00100000:3.0:1788463206.236270:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.236291:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652352 00000100:00100000:3.0:1788463206.236294:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652352 00000100:00100000:3.0:1788463206.236326:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463206.236331:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a40d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652352:12345-0@lo:1000: 00000100:00100000:3.0:1788463206.236377:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a40d41 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652352:12345-0@lo:1000: Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.236383:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463206.236398:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000030ff7c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788463206.236408:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652352:0@lo:1000: 00000004:00080000:3.0:1788463206.236449:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002879db25 with version 0 00000020:00100000:3.0:1788463206.236463:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788463206.236467:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000aef6fd25 x1875339485652608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463206.236477:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652608:0@lo:1000: 00000100:00100000:3.0:1788463206.236498:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.236514:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652608 00000100:00100000:3.0:1788463206.236517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652608 00000100:00100000:3.0:1788463206.236531:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463206.236534:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40dbe11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652608:12345-0@lo:1000: 00000100:00100000:3.0:1788463206.236872:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e1200e9 going to sleep for 11 seconds 00000040:01000000:0.0:1788463206.241383:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788463206.241500:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788463206.244386:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000004:00000080:0.0:1788463206.245244:0:7453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788463206.245279:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788463206.245549:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463206.246616:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 40000000:02000000:2.0:1788463206.246791:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788463206.248376:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40dbe11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652608:12345-0@lo:1000: Request processed in 11833us (11870us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788463206.248391:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788463206.251275:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788463206.251286:0:7478:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788463206.251305:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652608:0@lo:1000: 00000100:00100000:3.0:1788463206.251413:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652736:0@lo:1000: 00000100:00100000:3.0:1788463206.251492:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.252230:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089759b95 going to sleep for 11 seconds 00000040:00080000:0.0:1788463206.252557:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788463206.252870:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788463206.253119:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788463206.253408:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788463206.254270:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788463206.254491:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788463206.256825:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788463206.257270:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:3.0:1788463206.257989:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652736 00000100:00100000:3.0:1788463206.258009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652736 00000100:00100000:3.0:1788463206.258061:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463206.258070:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c50a99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652736:12345-0@lo:1000: 00100000:10000000:0.0:1788463206.258661:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788463206.258887:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788463206.259053:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788463206.259210:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788463206.259388:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788463206.259524:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788463206.259760:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788463206.259894:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788463206.260037:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788463206.260171:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788463206.260317:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788463206.260451:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000100:00100000:3.0:1788463206.260609:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c50a99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875339485652736:12345-0@lo:1000: Request processed in 2535us (9112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.260622:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:0.0:1788463206.260879:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788463206.261024:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:2.0:1788463206.261049:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e7d0e7c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1875339485651840:12345-0@lo:700: Request processed in 27223us (27434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463206.261059:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:0.0:1788463206.261169:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788463206.261324:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00010000:00080000:3.0:1788463206.261328:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008c601571 x1875339485651840/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788463222 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463206.261351:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875339485651840:0@lo:700: 40000000:02000000:3.0:1788463206.261365:0:7477:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1788463206.261789:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aef6fd25 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875339485652736:0@lo:1000: 00000040:00080000:1.0:1788463206.261821:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788463206.261861:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000004daa97cc with version 1 00000004:00080000:2.0:1788463206.261935:0:7468:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003e015dbb version 1 rpc_version 1 00000020:00100000:2.0:1788463206.261966:0:7468:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788463206.261972:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000501f6591 x1875339485652992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463206.261993:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875339485652992:0@lo:1000: 00000100:00100000:2.0:1788463206.262044:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463206.262087:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d98762e8 going to sleep for 11 seconds 00000040:00080000:1.0:1788463206.267296:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00100000:10000000:0.0:1788463206.267932:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788463206.268154:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:2.0:1788463206.268533:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485652992 00000100:00100000:2.0:1788463206.268544:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485652992 00000100:00100000:2.0:1788463206.268614:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463206.268624:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039c2222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875339485652992:12345-0@lo:1000: 00100000:10000000:0.0:1788463206.268968:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788463206.269189:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000004:00080000:1.0:1788463206.269537:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788463206.271076:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788463206.272830:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000001:00080000:1.0:1788463206.274459:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788463206.275722:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039c2222 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875339485652992:12345-0@lo:1000: Request processed in 7091us (13669us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788463206.275738:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788463206.276235:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788463206.276242:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463206.276261:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875339485652992:0@lo:1000: 00100000:10000000:0.0:1788463206.276445:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788463206.291658:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788463206.291866:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788463206.292071:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788463206.292206:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788463206.292372:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788463206.292566:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788463206.297429:0:7453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788463206.297471:0:7453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba4741c6b988 00100000:10000000:1.0:1788463206.297479:0:7453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788463206.298132:0:7453:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463206.298167:0:7453:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463206.298188:0:7453:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788463206.298207:0:7453:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788463206.299982:0:7453:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463206.300185:0:7453:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788463206.325401:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463206.352345:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788463206.352431:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788463206.352435:0:7477:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788463207.043906:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463208.067697:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463209.097277:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463210.115702:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463211.141136:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463211.397889:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485653504:0@lo:400: 00000100:00100000:0.0:1788463211.398064:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485653120:0@lo:400: 00000100:00100000:0.0:1788463211.402245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.402334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485653632:0@lo:41: 00000100:00100000:0.0:1788463211.402384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.402423:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653120 00000100:00100000:0.0:1788463211.402431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653120 00000100:00100000:0.0:1788463211.403137:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463211.403149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ddbaf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:3649:x1875339485653120:12345-0@lo:400: 00000100:00100000:0.0:1788463211.403216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ddbaf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:3649:x1875339485653120:12345-0@lo:400: Request processed in 70us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.403224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463211.403309:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.403354:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485653248:0@lo:400: 00000100:00100000:2.0:1788463211.403391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.403411:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463211.403419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485653376:0@lo:400: 00000100:00100000:2.0:1788463211.403444:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.403491:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653504 00000100:00100000:2.0:1788463211.403497:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653504 00000100:00100000:2.0:1788463211.403528:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653248 00000100:00100000:2.0:1788463211.403531:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653248 00000100:00100000:2.0:1788463211.403548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463211.403555:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdd7e621 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485653504:12345-0@lo:400: 00000100:00100000:2.0:1788463211.403628:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdd7e621 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485653504:12345-0@lo:400: Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.403635:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463211.403649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463211.403655:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a45ed513 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485653248:12345-0@lo:400: 00000100:00100000:2.0:1788463211.403685:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a45ed513 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485653248:12345-0@lo:400: Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.403691:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463211.403711:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653632 00000100:00100000:2.0:1788463211.403729:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653632 00000100:00100000:2.0:1788463211.403746:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653376 00000100:00100000:2.0:1788463211.403749:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653376 00000100:00100000:2.0:1788463211.403760:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463211.403766:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aedfe64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875339485653632:12345-0@lo:41: 00000004:00000024:2.0:1788463211.403809:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788463211.403854:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aedfe64 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875339485653632:12345-0@lo:41: Request processed in 88us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.403861:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463211.403876:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463211.403881:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049665438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485653376:12345-0@lo:400: 00000100:00100000:2.0:1788463211.403911:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049665438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485653376:12345-0@lo:400: Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.403918:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463211.403972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485653376:0@lo:400: 00010000:00080000:2.0:1788463211.403987:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ef060f77 x1875339485653248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463211.403997:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485653248:0@lo:400: 00010000:00080000:2.0:1788463211.404026:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005261a2bf x1875339485653504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463211.404035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485653504:0@lo:400: 00000100:00100000:1.0:1788463211.404861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485653632:0@lo:41: 00000100:00100000:1.0:1788463211.404879:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485653120:0@lo:400: 00000001:02000400:3.0:1788463211.880108:0:7723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788463211.908870:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463211.908879:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188d0ea000 from 4 10000000:01000000:1.0:1788463211.908884:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463211.908929:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.908942:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.908954:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463211.908977:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485653760:0@lo:101: 00000100:00100000:1.0:1788463211.909045:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.909101:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000833e39c7 going to sleep for 11 seconds 00000100:00100000:3.0:1788463211.909163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653760 00000100:00100000:3.0:1788463211.909172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653760 00000100:00100000:3.0:1788463211.909319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463211.909329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a229646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:6520:x1875339485653760:12345-0@lo:101: 00010000:00010000:3.0:1788463211.909346:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463211.909361:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c98129dd/0x841acb7f42a3940f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39408 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463211.909385:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c98129dd/0x841acb7f42a3940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39408 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463211.909397:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c98129dd/0x841acb7f42a3940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39408 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463211.909407:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c98129dd, rc 0) 00000100:00100000:3.0:1788463211.909471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a229646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:6520:x1875339485653760:12345-0@lo:101: Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.909478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463211.909565:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485653760:0@lo:101: 00010000:00010000:2.0:1788463211.909616:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.909625:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463211.909677:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485653888:0@lo:256: 00000100:00100000:2.0:1788463211.909709:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.914648:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485653888 00000100:00100000:1.0:1788463211.914662:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485653888 00000100:00100000:2.0:1788463211.914669:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a45adcc going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.914712:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463211.914724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000421ac59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:6520:x1875339485653888:12345-0@lo:256: 20000000:01000000:2.0:1788463211.914751:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463211.914765:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463211.915936:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788463211.916058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000421ac59e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:6520:x1875339485653888:12345-0@lo:256: Request processed in 1336us (6347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.916069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463211.916166:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005261a2bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485653888:0@lo:256: 10000000:01000000:1.0:1788463211.916216:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463211.916223:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.916233:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000003e426dbc/0x841acb7f42a39408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463211.916242:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788463211.916244:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618850d0800 from 21 10000000:01000000:1.0:1788463211.916246:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463211.916275:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.916291:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.916299:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463211.916316:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073fe4fc3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654016:0@lo:101: 00000100:00100000:1.0:1788463211.916354:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.916387:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f03f53c going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.916438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654016 00000100:00100000:2.0:1788463211.916445:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654016 00000100:00100000:2.0:1788463211.916522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463211.916530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000994f7ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:6520:x1875339485654016:12345-0@lo:101: 00010000:00010000:2.0:1788463211.916540:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463211.916551:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b28b58e/0x841acb7f42a3941d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39416 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.916570:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b28b58e/0x841acb7f42a3941d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39416 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.916610:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b28b58e/0x841acb7f42a3941d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39416 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.916618:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b28b58e, rc 0) 00000100:00100000:2.0:1788463211.916650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000994f7ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654016:12345-0@lo:101: Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.916656:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463211.918404:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073fe4fc3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654016:0@lo:101: 00010000:00010000:1.0:1788463211.918428:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463211.918438:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463211.918512:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000073fe4fc3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654144:0@lo:501: 00000100:00100000:1.0:1788463211.918557:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.918671:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f03f53c going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.918757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654144 00000100:00100000:2.0:1788463211.918764:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654144 00000100:00100000:2.0:1788463211.918812:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788463211.918830:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a61790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654144:12345-0@lo:501: 00000100:00100000:2.0:1788463211.919076:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a61790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654144:12345-0@lo:501: Request processed in 247us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.919085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788463211.919123:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000073fe4fc3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654144:0@lo:501: 00000100:00100000:2.0:1788463211.919155:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654272:0@lo:503: 00000100:00100000:2.0:1788463211.919193:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.919212:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb3fc9a1 going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.919224:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654272 00000100:00100000:2.0:1788463211.919228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654272 00000100:00100000:2.0:1788463211.919244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463211.919250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4c731b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654272:12345-0@lo:503: 00000100:00100000:2.0:1788463211.919321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4c731b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654272:12345-0@lo:503: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.919328:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463211.919363:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654272:0@lo:503: 00000100:00100000:0.0:1788463211.926261:0:7725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7725:1875339485654400:0@lo:502: 00000100:00100000:0.0:1788463211.926343:0:7725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.926384:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654400 00000100:00100000:0.0:1788463211.926390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654400 00000100:00100000:0.0:1788463211.926430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463211.926438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fedefa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7725:x1875339485654400:12345-0@lo:502: 00000100:00100000:0.0:1788463211.926556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fedefa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7725:x1875339485654400:12345-0@lo:502: Request processed in 118us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.926564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463211.926641:0:7725:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.926662:0:7725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7725:1875339485654400:0@lo:502: 00000100:00100000:0.0:1788463211.926705:0:7725:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7725:1875339485654528:0@lo:502: 00000100:00100000:0.0:1788463211.926740:0:7725:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.926760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654528 00000100:00100000:0.0:1788463211.926765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654528 00000100:00100000:0.0:1788463211.926786:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463211.926792:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cffeb70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7725:x1875339485654528:12345-0@lo:502: 00000100:00100000:0.0:1788463211.926847:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cffeb70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:7725:x1875339485654528:12345-0@lo:502: Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.926854:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463211.926884:0:7725:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.926895:0:7725:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7725:1875339485654528:0@lo:502: 00000040:00080000:0.0:1788463211.926912:0:7725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788463211.926979:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788463211.927001:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463211.927009:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927019:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 0000000006903212/0x841acb7f42a39416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463211.927028:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463211.927031:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618850d0800 from 4 10000000:01000000:0.0:1788463211.927033:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463211.927059:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927066:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927073:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463211.927092:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654656:0@lo:101: 00000100:00100000:0.0:1788463211.927115:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.927128:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.927140:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654656 00000100:00100000:0.0:1788463211.927143:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654656 00000100:00100000:0.0:1788463211.927163:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463211.927168:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b8e4bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485654656:12345-0@lo:101: 00010000:00010000:0.0:1788463211.927176:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463211.927185:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc77e8b3/0x841acb7f42a3942b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39424 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927203:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc77e8b3/0x841acb7f42a3942b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39424 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927212:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc77e8b3/0x841acb7f42a3942b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39424 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927220:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc77e8b3, rc 0) 00000100:00100000:0.0:1788463211.927249:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b8e4bfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485654656:12345-0@lo:101: Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.927254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463211.927283:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654656:0@lo:101: 00010000:00010000:0.0:1788463211.927293:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927301:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463211.927352:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654784:0@lo:256: 00000100:00100000:0.0:1788463211.927384:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.927397:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.927409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654784 00000100:00100000:0.0:1788463211.927412:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654784 00000100:00100000:0.0:1788463211.927431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788463211.927436:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c1d05cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485654784:12345-0@lo:256: 20000000:01000000:0.0:1788463211.927449:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463211.927462:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463211.927466:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788463211.927539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c1d05cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485654784:12345-0@lo:256: Request processed in 102us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.927547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788463211.927604:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654784:0@lo:256: 10000000:01000000:0.0:1788463211.927645:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463211.927650:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927657:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000007d8b3fb3/0x841acb7f42a39424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463211.927665:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788463211.927667:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788463211.927669:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463211.927681:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927697:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927705:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463211.927716:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654912:0@lo:101: 00000100:00100000:0.0:1788463211.927741:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.927754:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.927764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485654912 00000100:00100000:0.0:1788463211.927767:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485654912 00000100:00100000:0.0:1788463211.927785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463211.927790:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008649e1be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485654912:12345-0@lo:101: 00010000:00010000:0.0:1788463211.927797:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463211.927804:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cb26c51/0x841acb7f42a39439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39432 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927817:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cb26c51/0x841acb7f42a39439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39432 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927824:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cb26c51/0x841acb7f42a39439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39432 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927830:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cb26c51, rc 0) 00000100:00100000:0.0:1788463211.927856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008649e1be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485654912:12345-0@lo:101: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.927861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463211.927887:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485654912:0@lo:101: 00010000:00010000:0.0:1788463211.927902:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.927909:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463211.927948:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485655040:0@lo:501: 00000100:00100000:0.0:1788463211.927970:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.927983:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.927992:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655040 00000100:00100000:0.0:1788463211.927995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655040 00000100:00100000:0.0:1788463211.928014:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463211.928019:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a997d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485655040:12345-0@lo:501: 00000100:00100000:0.0:1788463211.928112:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a997d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485655040:12345-0@lo:501: Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.928118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463211.928146:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485655040:0@lo:501: 00000100:00100000:0.0:1788463211.928171:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485655168:0@lo:503: 00000100:00100000:0.0:1788463211.928203:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.928216:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cec85c29 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.928226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655168 00000100:00100000:0.0:1788463211.928230:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655168 00000100:00100000:0.0:1788463211.928247:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463211.928252:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039100c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485655168:12345-0@lo:503: 00000100:00100000:0.0:1788463211.928316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039100c7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485655168:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.928322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463211.928359:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008de9cbb1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485655168:0@lo:503: 00000100:00100000:1.0:1788463211.931482:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6ef97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7727:1875339485655296:0@lo:502: 00000100:00100000:1.0:1788463211.931562:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.931632:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000917969a1 going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.931690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655296 00000100:00100000:0.0:1788463211.931698:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655296 00000100:00100000:0.0:1788463211.934542:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463211.934559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e934350d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7727:x1875339485655296:12345-0@lo:502: 00000100:00100000:0.0:1788463211.934753:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e934350d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7727:x1875339485655296:12345-0@lo:502: Request processed in 200us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.934761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788463211.935063:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6ef97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7727:1875339485655296:0@lo:502: 00000020:01000000:2.0:1788463211.935097:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463211.935108:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463211.935110:0:7727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788463211.935116:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463211.935119:0:7727:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:2.0:1788463211.935140:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463211.935160:0:7727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e3593047) 00000020:00000080:2.0:1788463211.935181:0:7727:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788463211.935195:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463211.935294:0:7727:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788463211.935299:0:7727:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788463211.935306:0:7727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a39447 00010000:00080000:2.0:1788463211.935346:0:7727:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fd4b02e5@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463211.938455:0:7727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788463211.946078:0:7727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788463211.946093:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788463211.946143:0:7727:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788463211.946168:0:7727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3944e 00000100:00080000:3.0:1788463211.946180:0:7727:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463211.946186:0:7727:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000fd4b02e5 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463211.946223:0:7727:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008c601571 x1875339485655424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463211.946283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485655424:0@lo:38: 00000100:00100000:0.0:1788463211.946355:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.946438:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655424 00000100:00100000:1.0:1788463211.946446:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655424 00000100:00100000:1.0:1788463211.946480:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463211.946488:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008de9cbb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485655424:12345-0@lo:38: 00010000:00080000:1.0:1788463211.946511:0:6528:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1788463211.946549:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a39455 00000004:00100000:1.0:1788463211.946563:0:6528:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788463211.946569:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788463211.946711:0:7727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788463211.946756:0:7727:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788463211.947019:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463211.947029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dba6ef97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485655808:0@lo:400: 00000100:00100000:1.0:1788463211.947066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463211.947194:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031d06d3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485655552:0@lo:400: 00000100:00100000:3.0:1788463211.947238:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463211.947260:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463211.947265:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003494742a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485655680:0@lo:400: 00000100:00100000:3.0:1788463211.947287:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.947355:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788463211.947363:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788463211.947562:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655680 00000100:00100000:3.0:1788463211.947568:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655680 00000100:00100000:1.0:1788463211.947747:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463211.947754:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070ec2334 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485655680:12345-0@lo:400: 00000100:00100000:1.0:1788463211.947803:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070ec2334 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485655680:12345-0@lo:400: Request processed in 50us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463211.947811:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463211.947885:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003494742a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485655680:0@lo:400: 00000100:00100000:3.0:1788463211.948060:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655808 00000100:00100000:3.0:1788463211.948064:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655808 00000100:00100000:3.0:1788463211.948098:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655552 00000100:00100000:3.0:1788463211.948102:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655552 00000100:00100000:3.0:1788463211.948117:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463211.948122:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073fe4fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485655808:12345-0@lo:400: 00000100:00100000:3.0:1788463211.948161:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073fe4fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485655808:12345-0@lo:400: Request processed in 38us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.948173:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463211.948186:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463211.948191:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014174329 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485655552:12345-0@lo:400: 00000100:00100000:3.0:1788463211.948224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014174329 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485655552:12345-0@lo:400: Request processed in 33us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.948230:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788463211.948263:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dba6ef97 x1875339485655808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463211.948274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dba6ef97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485655808:0@lo:400: 00010000:00080000:3.0:1788463211.948297:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000031d06d3c x1875339485655552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463211.948305:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031d06d3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485655552:0@lo:400: 00000100:00080000:0.0:1788463211.949396:0:7731:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000028ada203 x1875339485655936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463211.949409:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a90012b8 going to sleep for 0 seconds 00000020:01000000:3.0:1788463211.949506:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463211.949512:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463211.949514:0:7727:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788463211.949517:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463211.949521:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463211.949522:0:7727:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463211.949525:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463211.949527:0:7727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788463211.949550:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050df903d pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7727:1875339485656064:0@lo:502: 00000100:00100000:3.0:1788463211.949645:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463211.949677:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d2d2ea0e going to sleep for 11 seconds 00000100:00100000:0.0:1788463211.949739:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656064 00000100:00100000:0.0:1788463211.949745:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656064 00000100:00100000:0.0:1788463211.949783:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463211.949790:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a589025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7727:x1875339485656064:12345-0@lo:502: 00000100:00100000:0.0:1788463211.949895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a589025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7727:x1875339485656064:12345-0@lo:502: Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463211.949903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463211.950098:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050df903d pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7727:1875339485656064:0@lo:502: 00000020:01000000:3.0:1788463211.950123:0:7727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463211.950128:0:7727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463211.950134:0:7727:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788463211.950138:0:7727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788463211.950229:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788463211.950248:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788463211.950257:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.950267:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 00000000008dfd03/0x841acb7f42a39432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463211.950288:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788463211.950290:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff961884ff19c0 from 1 10000000:01000000:0.0:1788463211.950293:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788463211.950324:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.950332:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463211.950340:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463211.950353:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fd84e09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485656192:0@lo:101: 00000100:00100000:0.0:1788463211.950381:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.950411:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ca10f7d going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.950449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656192 00000100:00100000:2.0:1788463211.950454:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656192 00000100:00100000:2.0:1788463211.950489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788463211.950496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c2f6fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485656192:12345-0@lo:101: 00010000:00010000:2.0:1788463211.950504:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463211.950516:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3945c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.950536:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3945c expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.950546:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da8e5ebf/0x841acb7f42a39463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3945c expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.950555:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da8e5ebf, rc 0) 00000100:00100000:2.0:1788463211.950619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c2f6fe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485656192:12345-0@lo:101: Request processed in 123us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.950625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788463211.950655:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fd84e09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485656192:0@lo:101: 00010000:00010000:2.0:1788463211.950667:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.950676:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463211.950740:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485656320:0@lo:501: 00000100:00100000:2.0:1788463211.950764:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.950782:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae1fb5ee going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.950793:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656320 00000100:00100000:2.0:1788463211.950797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656320 00000100:00100000:2.0:1788463211.950818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463211.950823:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a6b91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485656320:12345-0@lo:501: 00000100:00100000:2.0:1788463211.950882:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a6b91b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485656320:12345-0@lo:501: Request processed in 59us (117us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463211.950889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463211.950915:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef060f77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485656320:0@lo:501: 10000000:01000000:2.0:1788463211.950935:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788463211.950939:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463211.950946:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: 000000001aafa1bb/0x841acb7f42a3945c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788463211.967452:0:6528:0:(import.c:65:import_set_state_nolock()) 000000005ebd0a60 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463211.967566:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008de9cbb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485655424:12345-0@lo:38: Request processed in 21075us (21209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463211.967616:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463211.967662:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463211.967672:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788463211.967680:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788463211.967686:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788463211.967688:0:3647:0:(import.c:65:import_set_state_nolock()) 00000000fd4b02e5 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788463211.967960:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a90012b8): req@0000000028ada203 x1875339485655936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463211.968114:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c601571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485655424:0@lo:38: 00000100:00100000:2.0:1788463211.968199:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.968237:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a90012b8 going to sleep for 11 seconds 00000100:00100000:3.0:1788463211.968246:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485655936 00000100:00100000:3.0:1788463211.968254:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485655936 00000100:00100000:3.0:1788463211.968295:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463211.968302:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef060f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485655936:12345-0@lo:1000: 00000100:00100000:3.0:1788463211.968384:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef060f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485655936:12345-0@lo:1000: Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.968391:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788463211.968959:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000028ada203 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485655936:0@lo:1000: 00000040:01000000:2.0:1788463211.969167:0:7731:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788463211.969219:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656448:0@lo:1000: 00000100:00100000:2.0:1788463211.969259:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.969290:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 0000000074353a25 going to sleep for 11 seconds 00000100:00100000:3.0:1788463211.969319:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656448 00000100:00100000:3.0:1788463211.969326:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656448 00000100:00100000:3.0:1788463211.969361:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463211.969369:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af8b5960 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656448:12345-0@lo:1000: 00000100:00100000:3.0:1788463211.969480:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af8b5960 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656448:12345-0@lo:1000: Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.969487:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463211.969599:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656448:0@lo:1000: 00000100:00100000:2.0:1788463211.969653:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656576:0@lo:700: 00000100:00100000:2.0:1788463211.969679:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.969756:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae1fb5ee going to sleep for 11 seconds 00000100:00100000:1.0:1788463211.970813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485656704:0@lo:41: 00000100:00100000:1.0:1788463211.970862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463211.971082:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656704 00000100:00100000:2.0:1788463211.971090:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656704 00000100:00100000:2.0:1788463211.971155:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463211.971163:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345f6a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485656704:12345-0@lo:41: 00000004:00000024:2.0:1788463211.971194:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788463211.971250:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345f6a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485656704:12345-0@lo:41: Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.971256:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463211.971550:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485656704:0@lo:41: 00000100:00100000:3.0:1788463211.972743:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656576 00000100:00100000:3.0:1788463211.972755:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656576 00000100:00100000:3.0:1788463211.972798:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463211.972804:0:6532:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1788463211.972806:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005261a2bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656576:12345-0@lo:700: 00000100:00100000:0.0:1788463211.972812:0:6532:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:3.0:1788463211.972881:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005261a2bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656576:12345-0@lo:700: Request processed in 76us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.972890:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463211.973348:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656576:0@lo:700: 00000100:00100000:0.0:1788463211.973471:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e911eca3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656832:0@lo:1000: 00000100:00100000:0.0:1788463211.973517:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.973549:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d99b9d83 going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.973620:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485656832 00000100:00100000:2.0:1788463211.973626:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485656832 00000100:00100000:2.0:1788463211.973653:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463211.973659:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c74fe70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656832:12345-0@lo:1000: 00000100:00100000:2.0:1788463211.973727:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c74fe70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485656832:12345-0@lo:1000: Request processed in 68us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463211.973745:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463211.974171:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e911eca3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485656832:0@lo:1000: 00000004:00080000:0.0:1788463211.974221:0:7731:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000a90012b8 with version 0 00000020:00100000:0.0:1788463211.974237:0:7731:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788463211.974243:0:7731:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e911eca3 x1875339485657088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463211.974256:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e911eca3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485657088:0@lo:1000: 00000100:00100000:0.0:1788463211.974288:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463211.974301:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ff9f5fc going to sleep for 11 seconds 00000100:00100000:2.0:1788463211.976247:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657088 00000100:00100000:2.0:1788463211.976259:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657088 00000100:00100000:2.0:1788463211.976312:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463211.976320:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008133fe6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7731:x1875339485657088:12345-0@lo:1000: 00000001:00080000:3.0:1788463211.987368:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788463211.987382:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788463211.988297:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008133fe6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7731:x1875339485657088:12345-0@lo:1000: Request processed in 11974us (14004us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788463211.988310:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788463211.988926:0:7731:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788463211.988933:0:7731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788463211.988951:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e911eca3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485657088:0@lo:1000: 00000100:00100000:1.0:1788463211.989053:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485657216:0@lo:1000: 00000100:00100000:1.0:1788463211.989103:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463211.989141:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 000000000fb4f058 going to sleep for 11 seconds 00000100:00100000:3.0:1788463211.989617:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657216 00000100:00100000:3.0:1788463211.989626:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657216 00000100:00100000:3.0:1788463211.989670:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463211.989678:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa49301c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7731:x1875339485657216:12345-0@lo:1000: 00000100:00100000:3.0:1788463211.989780:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa49301c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7731:x1875339485657216:12345-0@lo:1000: Request processed in 103us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463211.989786:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463211.989899:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bccc8bad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875339485657216:0@lo:1000: 00000040:00080000:2.0:1788463211.989921:0:7731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788463211.989954:0:7731:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000074353a25 with version 1 00000004:00080000:3.0:1788463211.990604:0:7729:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000adcbb482 version 1 rpc_version 1 00000020:00100000:3.0:1788463211.990628:0:7729:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788463211.990636:0:7729:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000050df903d x1875339485657472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463211.990653:0:7729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050df903d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7729:1875339485657472:0@lo:1000: 00000100:00100000:3.0:1788463211.990706:0:7729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463211.990726:0:7729:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079869d52 going to sleep for 11 seconds 00000040:00080000:2.0:1788463211.992067:0:7731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788463211.992137:0:7731:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788463211.992143:0:7731:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1788463211.992243:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657472 00000100:00100000:2.0:1788463211.992252:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657472 00000100:00100000:2.0:1788463211.992307:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463211.992316:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f6705c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7729:x1875339485657472:12345-0@lo:1000: 00000001:00080000:1.0:1788463212.001478:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788463212.001713:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f6705c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7729:x1875339485657472:12345-0@lo:1000: Request processed in 9395us (11002us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788463212.001727:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788463212.001874:0:7729:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788463212.001891:0:7729:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463212.001909:0:7729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050df903d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7729:1875339485657472:0@lo:1000: 00010000:00010000:2.0:1788463212.168291:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788463212.921419:0:7782:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463212.923089:0:7782:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463213.187804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463214.214594:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463215.235732:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463216.080376:0:7884:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463216.080618:0:7884:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788463216.261074:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463216.516600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463216.516624:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485657600:0@lo:41: 00000100:00100000:1.0:1788463216.516691:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463216.516841:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657600 00000100:00100000:3.0:1788463216.516851:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657600 00000100:00100000:3.0:1788463216.516913:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463216.516921:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002afc9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485657600:12345-0@lo:41: 00000004:00000024:3.0:1788463216.516954:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788463216.517008:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002afc9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485657600:12345-0@lo:41: Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463216.517014:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463216.517384:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485657600:0@lo:41: 00000100:00100000:0.0:1788463217.027894:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463217.028049:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463217.028070:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485658112:0@lo:400: 00000100:00100000:3.0:1788463217.028145:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463217.028227:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658112 00000100:00100000:3.0:1788463217.028235:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658112 00000100:00100000:3.0:1788463217.028293:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463217.028301:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a33cbe01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485658112:12345-0@lo:400: 00000100:00100000:3.0:1788463217.028355:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a33cbe01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485658112:12345-0@lo:400: Request processed in 55us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.028362:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463217.028404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485658112:0@lo:400: 00000100:00100000:0.0:1788463217.033054:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485657728:0@lo:41: 00000100:00100000:0.0:1788463217.033138:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.033408:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657728 00000100:00100000:1.0:1788463217.033417:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657728 00000100:00100000:1.0:1788463217.033469:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463217.033476:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d432865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485657728:12345-0@lo:41: 00000004:00000024:1.0:1788463217.033525:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788463217.033605:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d432865 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485657728:12345-0@lo:41: Request processed in 129us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.033612:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463217.033867:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485657856:0@lo:400: 00000100:00100000:2.0:1788463217.033903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.033945:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463217.033951:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485657984:0@lo:400: 00000100:00100000:2.0:1788463217.034009:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463217.034429:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657984 00000100:00100000:3.0:1788463217.034435:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657984 00000100:00100000:3.0:1788463217.034480:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463217.034486:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6a3540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485657984:12345-0@lo:400: 00000100:00100000:3.0:1788463217.034544:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6a3540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485657984:12345-0@lo:400: Request processed in 59us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.034551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788463217.034620:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000501f6591 x1875339485657984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463217.034634:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000501f6591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485657984:0@lo:400: 00000100:00100000:3.0:1788463217.034661:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485658240:0@lo:400: 00000100:00100000:3.0:1788463217.034687:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463217.034717:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658240 00000100:00100000:3.0:1788463217.034721:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658240 00000100:00100000:3.0:1788463217.034746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463217.034751:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d45818fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485658240:12345-0@lo:400: 00000100:00100000:3.0:1788463217.034782:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d45818fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485658240:12345-0@lo:400: Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.034787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788463217.034810:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fc7d25ac x1875339485658240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463217.034826:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc7d25ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485658240:0@lo:400: 00000100:00100000:1.0:1788463217.034972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485657856 00000100:00100000:1.0:1788463217.034978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485657856 00000100:00100000:1.0:1788463217.035017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463217.035023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa54aa27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3648:x1875339485657856:12345-0@lo:400: 00000100:00100000:1.0:1788463217.035059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa54aa27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3648:x1875339485657856:12345-0@lo:400: Request processed in 36us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.035064:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463217.035627:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000059c189c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485657728:0@lo:41: 00000100:00100000:3.0:1788463217.035766:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005b1a4de8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485657856:0@lo:400: 00000020:00000080:2.0:1788463217.160035:0:7932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed0916590 20000000:00000080:2.0:1788463217.160056:0:7932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96188f275800 uarg=0000000000000000 20000000:01000000:2.0:1788463217.160099:0:7932:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788463217.160106:0:7932:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788463217.160113:0:7932:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788463217.160199:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788463217.160210:0:7932:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788463217.164093:0:7932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463217.164324:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788463217.164360:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788463217.164377:0:7932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788463217.164393:0:7932:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463217.164412:0:7932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164431:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164438:0:7932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164444:0:7932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164481:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164506:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463217.164520:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f49154fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875339485658368:0@lo:104: 00000100:00100000:2.0:1788463217.164695:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463217.164764:0:7932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.164772:0:7932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 17 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463217.164789:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7b5f85b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875339485658496:0@lo:104: 00000100:00100000:2.0:1788463217.164811:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0537602 going to sleep for 11 seconds 00000100:00100000:1.0:1788463217.164941:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788463217.164970:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.164998:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658368 00000100:00100000:1.0:1788463217.165004:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658368 00000100:00100000:1.0:1788463217.165038:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658496 00000100:00100000:1.0:1788463217.165041:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658496 00000100:00100000:1.0:1788463217.165054:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463217.165061:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e18db3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:7932:x1875339485658368:12345-0@lo:104: 00010000:00010000:1.0:1788463217.165073:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165135:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463217.165140:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e18db3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:7932:x1875339485658368:12345-0@lo:104: Request processed in 80us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.165147:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463217.165181:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463217.165187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091365740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:7932:x1875339485658496:12345-0@lo:104: 00010000:00010000:1.0:1788463217.165195:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165227:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463217.165231:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091365740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:7932:x1875339485658496:12345-0@lo:104: Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.165237:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788463217.165252:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463217.165256:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165263:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009df2a462 already unused, calling callback (0000000029e2dd3c) 10000000:00010000:1.0:1788463217.165266:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165283:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463217.165289:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463217.165294:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463217.165322:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165330:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463217.165345:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165351:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 000000009df2a462/0x841acb7f42a393d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393d7 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165363:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463217.165365:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165369:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000699d5fbc already unused, calling callback (0000000029e2dd3c) 10000000:00010000:1.0:1788463217.165371:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165377:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463217.165381:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463217.165391:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463217.165403:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165409:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463217.165413:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165419:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: 00000000699d5fbc/0x841acb7f42a392e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a392e9 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165431:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463217.165433:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463217.165434:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788463217.165444:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463217.165447:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188d0ea000 from 1 10000000:01000000:1.0:1788463217.165450:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463217.165467:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: 000000009b5867f1/0x841acb7f42a39471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165473:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: 000000009b5867f1/0x841acb7f42a39471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.165480:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: 000000009b5867f1/0x841acb7f42a39471 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463217.165504:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b611223f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485658880:0@lo:101: 00000100:00100000:1.0:1788463217.165533:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.165549:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a0bea4e going to sleep for 11 seconds 00000100:00100000:1.0:1788463217.165562:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fecccf79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485658752:0@lo:103: 00000100:00100000:1.0:1788463217.165619:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.165637:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463217.165642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf93ce23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485658624:0@lo:103: 00000100:00100000:1.0:1788463217.165662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.165833:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f49154fd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875339485658368:0@lo:104: 00000100:00100000:2.0:1788463217.165843:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7b5f85b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7932:1875339485658496:0@lo:104: 00010000:00010000:2.0:1788463217.165860:0:7932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463217.166003:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658752 00000100:00100000:3.0:1788463217.166008:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658752 00010000:00010000:3.0:1788463217.166027:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 18 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463217.166054:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658624 00000100:00100000:3.0:1788463217.166057:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658624 00010000:00010000:3.0:1788463217.166066:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 19 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463217.166090:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463217.166097:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bdd6a97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3649:x1875339485658752:12345-0@lo:103: 00010000:00010000:3.0:1788463217.166106:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463217.166111:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 19 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166120:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 19 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166131:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004274a1ed/0x841acb7f42a392e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a392e2 expref: 19 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166142:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463217.166175:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bdd6a97 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485658752:12345-0@lo:103: Request processed in 80us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.166182:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463217.166203:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463217.166208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c8fd75e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3649:x1875339485658624:12345-0@lo:103: 00010000:00010000:3.0:1788463217.166215:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463217.166219:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166227:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166236:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030ecab7a/0x841acb7f42a393d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a393d0 expref: 17 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166245:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166252:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166263:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166269:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166274:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166280:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166285:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000551d17f8 already unused, calling callback (00000000c265efd7) 00010000:00010000:3.0:1788463217.166288:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166300:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166309:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.166318:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463217.166340:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c8fd75e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3649:x1875339485658624:12345-0@lo:103: Request processed in 132us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.166347:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463217.166376:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf93ce23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485658624:0@lo:103: 00000100:00100000:3.0:1788463217.166383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fecccf79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485658752:0@lo:103: 00010000:00010000:2.0:1788463217.166485:0:7932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.166504:0:7932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.166509:0:7932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000551d17f8/0x841acb7f42a3946a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.168628:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463217.169570:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485658880 00000100:00100000:0.0:1788463217.169596:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485658880 00000100:00100000:0.0:1788463217.169644:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463217.169652:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33d3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485658880:12345-0@lo:101: 00010000:00010000:0.0:1788463217.169669:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463217.169685:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b89407d/0x841acb7f42a39478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39471 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463217.169707:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b89407d/0x841acb7f42a39478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39471 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463217.169716:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b89407d/0x841acb7f42a39478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39471 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463217.169723:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b89407d, rc 0) 00000100:00100000:0.0:1788463217.169800:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33d3671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485658880:12345-0@lo:101: Request processed in 148us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463217.169806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463217.172797:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b611223f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485658880:0@lo:101: 00010000:00010000:1.0:1788463217.172826:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: 000000009b5867f1/0x841acb7f42a39471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463217.172843:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: 000000009b5867f1/0x841acb7f42a39471 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463217.172926:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b611223f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659008:0@lo:501: 00000100:00100000:1.0:1788463217.172994:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.173032:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a0bea4e going to sleep for 11 seconds 00000100:00100000:3.0:1788463217.173297:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659008 00000100:00100000:3.0:1788463217.173305:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659008 00000100:00100000:3.0:1788463217.173364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463217.173372:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a9fcda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485659008:12345-0@lo:501: 00000100:00100000:3.0:1788463217.173607:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a9fcda6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485659008:12345-0@lo:501: Request processed in 235us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.173616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788463217.184153:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b611223f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659008:0@lo:501: 00000100:00100000:2.0:1788463217.184215:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7b5f85b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659136:0@lo:503: 00000100:00100000:2.0:1788463217.184291:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.184326:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0537602 going to sleep for 11 seconds 00000100:00100000:2.0:1788463217.194328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659136 00000100:00100000:2.0:1788463217.194342:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659136 00000100:00100000:2.0:1788463217.194460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463217.194469:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abf904af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485659136:12345-0@lo:503: 00000100:00100000:2.0:1788463217.194661:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abf904af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485659136:12345-0@lo:503: Request processed in 193us (10370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463217.194669:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463217.194776:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7b5f85b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659136:0@lo:503: 00000100:00100000:3.0:1788463217.194986:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bbbe227d pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7934:1875339485659264:0@lo:502: 00000100:00100000:3.0:1788463217.195028:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463217.204440:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab31814c going to sleep for 11 seconds 00000100:00100000:0.0:1788463217.204613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659264 00000100:00100000:0.0:1788463217.204623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659264 00000100:00100000:0.0:1788463217.204675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463217.204683:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f88b30d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7934:x1875339485659264:12345-0@lo:502: 00000100:00100000:0.0:1788463217.204872:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f88b30d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7934:x1875339485659264:12345-0@lo:502: Request processed in 189us (9843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463217.204880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463217.209692:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bbbe227d pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7934:1875339485659264:0@lo:502: 00000020:01000000:3.0:1788463217.209746:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463217.209766:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463217.209769:0:7934:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463217.209785:0:7934:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188d0ea000 00000020:00000080:3.0:1788463217.209788:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788463217.209844:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7934:1875339485659392:0@lo:502: 00000100:00100000:3.0:1788463217.209920:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463217.209963:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463217.210145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659392 00000100:00100000:2.0:1788463217.210153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659392 00000100:00100000:2.0:1788463217.210202:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463217.210210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7934:x1875339485659392:12345-0@lo:502: 00000100:00100000:2.0:1788463217.210323:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:7934:x1875339485659392:12345-0@lo:502: Request processed in 112us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463217.210330:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463217.214277:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7934:1875339485659392:0@lo:502: 00000020:01000000:3.0:1788463217.214325:0:7934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463217.214335:0:7934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463217.214338:0:7934:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788463217.214343:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788463217.214527:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788463217.214550:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463217.214562:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.214600:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463217.214612:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463217.214614:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618850d0800 from 1 10000000:01000000:2.0:1788463217.214617:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463217.214652:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.214660:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.214670:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463217.214700:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659520:0@lo:101: 00000100:00100000:2.0:1788463217.214767:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.214825:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463217.215113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659520 00000100:00100000:3.0:1788463217.215120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659520 00000100:00100000:3.0:1788463217.215164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788463217.215173:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485659520:12345-0@lo:101: 00010000:00010000:3.0:1788463217.215186:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463217.215199:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3947f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.215220:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3947f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.215231:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3947f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463217.215239:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00e800, rc 0) 00000100:00100000:3.0:1788463217.215275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485659520:12345-0@lo:101: Request processed in 103us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.215282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463217.215693:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659520:0@lo:101: 00010000:00010000:2.0:1788463217.215709:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.215719:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463217.216031:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659648:0@lo:501: 00000100:00100000:2.0:1788463217.216064:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.216088:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463217.216620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659648 00000100:00100000:3.0:1788463217.216627:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659648 00000100:00100000:3.0:1788463217.216667:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463217.216676:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485659648:12345-0@lo:501: 00000100:00100000:3.0:1788463217.216785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485659648:12345-0@lo:501: Request processed in 109us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463217.216792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463217.216893:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659648:0@lo:501: 00000100:00100000:2.0:1788463217.216924:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659776:0@lo:503: 00000100:00100000:2.0:1788463217.216967:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.217001:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463217.217073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659776 00000100:00100000:1.0:1788463217.217077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659776 00000100:00100000:1.0:1788463217.217356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463217.217365:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485659776:12345-0@lo:503: 00000100:00100000:1.0:1788463217.217449:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485659776:12345-0@lo:503: Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.217457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788463217.226703:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485659776:0@lo:503: 00000100:00100000:0.0:1788463217.228650:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7937:1875339485659904:0@lo:502: 00000100:00100000:0.0:1788463217.228744:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463217.228913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485659904 00000100:00100000:2.0:1788463217.228920:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485659904 00000100:00100000:2.0:1788463217.228966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463217.228977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:7937:x1875339485659904:12345-0@lo:502: 00000100:00100000:2.0:1788463217.229088:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:7937:x1875339485659904:12345-0@lo:502: Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463217.229187:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463217.229208:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7937:1875339485659904:0@lo:502: 00000020:01000000:0.0:1788463217.229236:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463217.229246:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463217.229248:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788463217.229258:0:7937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618850d0800 00000020:00000080:0.0:1788463217.229261:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788463217.229283:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7937:1875339485660032:0@lo:502: 00000100:00100000:0.0:1788463217.229315:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463217.229340:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618864e4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463217.230875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463217.231016:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660032 00000100:00100000:2.0:1788463217.231025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660032 00000100:00100000:2.0:1788463217.231070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463217.231078:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:7937:x1875339485660032:12345-0@lo:502: 00000100:00100000:2.0:1788463217.231856:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:7937:x1875339485660032:12345-0@lo:502: Request processed in 776us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463217.231864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463217.232386:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:7937:1875339485660032:0@lo:502: 00000020:01000000:0.0:1788463217.232423:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463217.232431:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463217.232433:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788463217.232441:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788463217.232774:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788463217.232798:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463217.232808:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.232819:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463217.284732:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463218.307901:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463219.338668:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463220.366600:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463221.382758:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463221.638564:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485660160:0@lo:41: 00000100:00100000:0.0:1788463221.638666:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463221.638842:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660160 00000100:00100000:1.0:1788463221.638850:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660160 00000100:00100000:1.0:1788463221.638906:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463221.638915:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485660160:12345-0@lo:41: 00000004:00000024:1.0:1788463221.638949:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788463221.639012:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485660160:12345-0@lo:41: Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463221.639019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463221.639929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485660160:0@lo:41: 00000100:00100000:2.0:1788463222.150291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485660288:0@lo:41: 00000100:00100000:2.0:1788463222.150363:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463222.150476:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660288 00000100:00100000:0.0:1788463222.150492:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660288 00000100:00100000:0.0:1788463222.150544:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463222.150553:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485660288:12345-0@lo:41: 00000004:00000024:0.0:1788463222.150636:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788463222.154233:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485660672:0@lo:400: 00000100:00100000:1.0:1788463222.154306:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463222.154372:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485660544:0@lo:400: 00000100:00100000:1.0:1788463222.154408:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463222.154429:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463222.154435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485660416:0@lo:400: 00000100:00100000:1.0:1788463222.154461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463222.154498:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660672 00000100:00100000:1.0:1788463222.154506:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660672 00000100:00100000:1.0:1788463222.154550:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660544 00000100:00100000:1.0:1788463222.154553:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660544 00000100:00100000:1.0:1788463222.154569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463222.154599:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485660672:12345-0@lo:400: 00000100:00100000:1.0:1788463222.154652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485660672:12345-0@lo:400: Request processed in 56us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463222.154661:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463222.154678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463222.154698:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485660544:12345-0@lo:400: 00000100:00100000:1.0:1788463222.154728:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485660544:12345-0@lo:400: Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463222.154734:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788463222.154771:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188cf32a00 x1875339485660544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463222.154785:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485660544:0@lo:400: 00010000:00080000:1.0:1788463222.154823:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188cf32300 x1875339485660672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463222.154833:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485660672:0@lo:400: 00000100:00100000:0.0:1788463222.156110:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485660288:12345-0@lo:41: Request processed in 5549us (5739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463222.156121:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463222.158736:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660416 00000100:00100000:0.0:1788463222.158752:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660416 00000100:00100000:0.0:1788463222.158832:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463222.158843:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485660416:12345-0@lo:400: 00000100:00100000:0.0:1788463222.158943:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485660416:12345-0@lo:400: Request processed in 103us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463222.158951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788463222.159195:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485660416:0@lo:400: 00000100:00100000:2.0:1788463222.162134:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485660288:0@lo:41: 00010000:00010000:0.0:1788463222.405837:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463223.428043:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463224.451746:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463225.476233:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463226.505862:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463226.756844:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463226.765875:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485660800:0@lo:41: 00000100:00100000:0.0:1788463226.765948:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463226.766137:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660800 00000100:00100000:1.0:1788463226.766146:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660800 00000100:00100000:1.0:1788463226.766198:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463226.766208:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485660800:12345-0@lo:41: 00000004:00000024:1.0:1788463226.766244:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788463226.766295:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485660800:12345-0@lo:41: Request processed in 88us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463226.766313:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463226.766362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485660800:0@lo:41: 00000100:00100000:2.0:1788463227.272642:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485661312:0@lo:400: 00000100:00100000:2.0:1788463227.272718:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.272798:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463227.272804:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485661184:0@lo:400: 00000100:00100000:2.0:1788463227.272826:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.272870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661312 00000100:00100000:2.0:1788463227.272880:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661312 00000100:00100000:2.0:1788463227.272930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661184 00000100:00100000:2.0:1788463227.272932:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661184 00000100:00100000:2.0:1788463227.272946:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463227.272955:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485661312:12345-0@lo:400: 00000100:00100000:2.0:1788463227.273007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485661312:12345-0@lo:400: Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.273014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463227.273031:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463227.273037:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485661184:12345-0@lo:400: 00000100:00100000:2.0:1788463227.273373:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485661184:12345-0@lo:400: Request processed in 336us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.273380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788463227.273425:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d111f80 x1875339485661184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463227.273440:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485661184:0@lo:400: 00010000:00080000:2.0:1788463227.273451:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d111180 x1875339485661312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463227.273459:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485661312:0@lo:400: 00000100:00100000:2.0:1788463227.274062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485661056:0@lo:400: 00000100:00100000:2.0:1788463227.274107:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.274158:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788463227.274166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485660928:0@lo:41: 00000100:00100000:2.0:1788463227.274192:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.274218:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485661440:0@lo:400: 00000100:00100000:2.0:1788463227.274251:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.274283:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485660928 00000100:00100000:2.0:1788463227.274288:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485660928 00000100:00100000:2.0:1788463227.274334:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661440 00000100:00100000:2.0:1788463227.274337:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661440 00000100:00100000:2.0:1788463227.274350:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463227.274357:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485660928:12345-0@lo:41: 00000004:00000024:2.0:1788463227.274388:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788463227.274425:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485660928:12345-0@lo:41: Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.274431:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463227.274443:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463227.274449:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485661440:12345-0@lo:400: 00000100:00100000:2.0:1788463227.274476:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485661440:12345-0@lo:400: Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.274482:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463227.274515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485660928:0@lo:41: 00000100:00100000:2.0:1788463227.274523:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485661440:0@lo:400: 00000100:00100000:3.0:1788463227.274606:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661056 00000100:00100000:3.0:1788463227.274610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661056 00000100:00100000:3.0:1788463227.274640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463227.274646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485661056:12345-0@lo:400: 00000100:00100000:3.0:1788463227.274678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485661056:12345-0@lo:400: Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463227.274684:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463227.274709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485661056:0@lo:400: 00010000:00010000:1.0:1788463227.525665:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463227.691569:0:8432:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463227.693366:0:8432:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788463227.693368:0:8432:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788463227.693505:0:8432:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96188f7d1000 00000020:01000004:2.0:1788463227.693524:0:8432:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788463227.693538:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463227.693561:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff96188f9b99c0) 00000020:00000080:2.0:1788463227.695215:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788463227.739635:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788463227.739692:0:8432:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788463227.755458:0:8432:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788463227.755688:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788463227.755699:0:8432:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788463227.755710:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a39494 00000020:01000004:0.0:1788463227.755717:0:8432:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788463227.755737:0:8432:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788463227.755741:0:8432:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788463227.755747:0:8432:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788463227.755751:0:8432:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788463227.755773:0:8432:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96188fbd19c0) 00000020:00000080:0.0:1788463227.755785:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788463227.764432:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463227.764743:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463227.764757:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788463227.769508:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463227.769545:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788463227.770205:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788463227.770213:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788463227.773116:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463227.773327:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788463227.773334:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788463227.774217:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788463227.774225:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788463227.824861:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463227.825244:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463227.825250:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788463227.837019:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788463227.837045:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788463227.837878:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463227.837897:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788463227.842989:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463227.843304:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788463227.843313:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788463227.844224:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788463227.844234:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788463227.926634:0:8432:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463227.927317:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463227.927323:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788463227.930447:0:8432:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788463227.930463:0:8432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788463227.934566:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788463227.934701:0:8432:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788463227.934708:0:8432:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788463227.964187:0:8432:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463227.964243:0:8432:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788463227.964247:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463227.964249:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463227.964250:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463227.964251:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463227.964252:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463227.964253:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463227.964255:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463227.964256:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788463227.964258:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788463227.964259:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463227.964261:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463227.964264:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788463227.964267:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463227.964268:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463227.964269:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463227.964271:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463227.964272:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463227.964273:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463227.964274:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463227.964275:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788463227.964276:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788463227.964289:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463227.964291:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463227.964317:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788463227.964336:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485661568:0@lo:253: 00000100:00100000:2.0:1788463227.964407:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.964535:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463227.964850:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661568 00000100:00100000:0.0:1788463227.964857:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661568 00000100:00100000:0.0:1788463227.964931:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788463227.964940:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:8432:x1875339485661568:12345-0@lo:253: 20000000:01000000:0.0:1788463227.964984:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788463227.964988:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788463227.964994:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788463227.964997:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788463227.965392:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463227.965524:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788463227.965539:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788463227.965556:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788463227.965562:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788463227.965660:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788463227.965679:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788463227.965757:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788463227.965771:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:0.0:1788463227.965773:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:0.0:1788463227.965787:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788463227.965800:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788463227.965816:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788463227.965822:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:0.0:1788463227.965833:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788463227.965838:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788463227.965849:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788463227.965863:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788463227.965927:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788463227.965938:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:0.0:1788463227.965940:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:0.0:1788463227.965953:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788463227.965959:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788463227.965987:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788463227.965994:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:0.0:1788463227.966007:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788463227.966012:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788463227.966151:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788463227.966171:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788463227.966556:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788463227.966570:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:0.0:1788463227.967214:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:0.0:1788463227.967241:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788463227.967250:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788463227.967260:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788463227.967265:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:0.0:1788463227.967275:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788463227.967292:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788463227.967304:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788463227.967317:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788463227.967330:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788463227.967341:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788463227.967344:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788463227.967386:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788463227.967388:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788463227.968665:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788463227.968704:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788463227.968717:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788463227.968940:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788463227.968962:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788463227.968986:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788463227.968997:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788463227.968999:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788463227.969362:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788463227.969473:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788463227.969488:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788463227.969512:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788463227.969522:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788463227.969524:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788463227.969837:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788463227.969857:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788463227.969872:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788463227.969983:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788463227.969998:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788463227.970009:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788463227.970015:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788463227.970017:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788463227.971917:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788463227.971965:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788463227.971980:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788463227.972161:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788463227.972185:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788463227.972198:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:2.0:1788463227.972214:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788463227.972235:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972254:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39367 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972262:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a393de expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972269:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39416 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972276:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39432 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972295:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3945c expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972313:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972351:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972365:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 18 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.972380:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661696:0@lo:104: 00000100:00100000:2.0:1788463227.972441:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463227.972498:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972506:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 18 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.972515:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661824:0@lo:104: 00000100:00100000:2.0:1788463227.972536:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463227.972566:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.972604:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 18 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.972613:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661952:0@lo:104: 00000100:00100000:2.0:1788463227.972633:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.972694:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661696 00000100:00100000:1.0:1788463227.972702:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661696 00000100:00100000:1.0:1788463227.972734:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661824 00000100:00100000:1.0:1788463227.972737:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661824 00000100:00100000:1.0:1788463227.972747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485661952 00000100:00100000:1.0:1788463227.972749:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485661952 00000100:00100000:1.0:1788463227.972761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463227.972769:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6518:x1875339485661696:12345-0@lo:104: 00010000:00010000:1.0:1788463227.972782:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.972852:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463227.972858:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6518:x1875339485661696:12345-0@lo:104: Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.972865:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463227.972880:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463227.972887:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485661824:12345-0@lo:104: 00010000:00010000:1.0:1788463227.972894:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.972925:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463227.972930:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485661824:12345-0@lo:104: Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.972936:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463227.972947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463227.972953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485661952:12345-0@lo:104: 00010000:00010000:1.0:1788463227.972961:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.972987:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788463227.972991:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485661952:12345-0@lo:104: Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.972997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788463227.973011:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463227.973017:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973024:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463227.973033:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973042:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463227.973049:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463227.973055:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463227.973087:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973093:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463227.973112:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973119:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5a00/0x841acb7f42a3945c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39463 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973132:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463227.973135:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973140:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463227.973143:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973149:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463227.973166:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463227.973171:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463227.973186:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973192:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463227.973206:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973213:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030c00/0x841acb7f42a39432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39439 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973222:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463227.973226:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973231:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463227.973233:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973240:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463227.973247:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463227.973252:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463227.973272:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973296:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463227.973303:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973310:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a39416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3941d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973321:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463227.973322:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463227.973324:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463227.973344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485662080:0@lo:103: 00000100:00100000:1.0:1788463227.973373:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.973410:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485662208:0@lo:103: 00000100:00100000:1.0:1788463227.973431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.973449:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463227.973454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485662336:0@lo:103: 00000100:00100000:1.0:1788463227.973473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.973501:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662080 00000100:00100000:1.0:1788463227.973505:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662080 00010000:00010000:1.0:1788463227.973524:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 19 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.973544:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662208 00000100:00100000:1.0:1788463227.973547:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662208 00010000:00010000:1.0:1788463227.973557:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 20 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.973568:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662336 00000100:00100000:1.0:1788463227.973600:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662336 00010000:00010000:1.0:1788463227.973613:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 21 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.973627:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463227.973633:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3649:x1875339485662080:12345-0@lo:103: 00010000:00010000:1.0:1788463227.973642:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.973647:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 21 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973656:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 21 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973670:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463227.973697:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3649:x1875339485662080:12345-0@lo:103: Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.973702:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463227.973716:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463227.973721:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3650:x1875339485662208:12345-0@lo:103: 00010000:00010000:1.0:1788463227.973728:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.973732:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 20 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973740:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 20 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973749:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463227.973772:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3650:x1875339485662208:12345-0@lo:103: Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.973778:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463227.973798:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463227.973803:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3650:x1875339485662336:12345-0@lo:103: 00010000:00010000:1.0:1788463227.973810:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.973814:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 19 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973823:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 19 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.973833:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463227.973917:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.973933:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 19 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.973943:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485662464:0@lo:104: 00000100:00100000:2.0:1788463227.973972:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463227.974003:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.974010:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 19 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.974017:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485662592:0@lo:104: 00000100:00100000:2.0:1788463227.974037:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.974048:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788463227.974067:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207e600/0x841acb7f42a39463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3945c expref: 19 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.974078:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661696:0@lo:104: 00010000:00010000:2.0:1788463227.974086:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030e00/0x841acb7f42a39439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39432 expref: 18 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.974094:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661824:0@lo:104: 00010000:00010000:2.0:1788463227.974102:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207f400/0x841acb7f42a3941d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39416 expref: 17 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.974109:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485661952:0@lo:104: 00000100:00100000:3.0:1788463227.974187:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662464 00000100:00100000:3.0:1788463227.974197:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662464 00000100:00100000:3.0:1788463227.974217:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662592 00000100:00100000:3.0:1788463227.974220:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662592 00000100:00100000:3.0:1788463227.974232:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463227.974239:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485662464:12345-0@lo:104: 00010000:00010000:3.0:1788463227.974248:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463227.974317:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463227.974323:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485662464:12345-0@lo:104: Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463227.974329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463227.974347:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463227.974353:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485662592:12345-0@lo:104: 00010000:00010000:3.0:1788463227.974360:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463227.974386:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463227.974391:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485662592:12345-0@lo:104: Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463227.974396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463227.974436:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3650:x1875339485662336:12345-0@lo:103: Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.974445:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463227.974483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485662080:0@lo:103: 00000100:00100000:1.0:1788463227.974506:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485662336:0@lo:103: 00000100:00100000:1.0:1788463227.974513:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485662208:0@lo:103: 00010000:00010000:1.0:1788463227.974528:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463227.974532:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.974539:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463227.974542:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.974550:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463227.974557:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463227.974570:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463227.974686:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463227.974815:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463227.974823:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463227.974829:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463227.974832:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463227.974839:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463227.974845:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463227.974849:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463227.974873:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463227.974888:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463227.974902:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463227.974908:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a39367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3936e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463227.974918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463227.974920:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463227.974922:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463227.974927:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463227.974929:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463227.974973:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.974978:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463227.974984:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.974990:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207e200/0x841acb7f42a393de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a393e5 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975002:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463227.975003:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463227.975005:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463227.975014:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485662720:0@lo:103: 00000100:00100000:1.0:1788463227.975042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.975081:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463227.975087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485662848:0@lo:103: 00000100:00100000:1.0:1788463227.975110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.975136:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662720 00000100:00100000:1.0:1788463227.975140:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662720 00010000:00010000:1.0:1788463227.975156:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 16 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.975174:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662848 00000100:00100000:1.0:1788463227.975176:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662848 00010000:00010000:1.0:1788463227.975186:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 17 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.975212:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463227.975219:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3648:x1875339485662720:12345-0@lo:103: 00010000:00010000:1.0:1788463227.975228:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.975233:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 17 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975240:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 17 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975253:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463227.975292:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3648:x1875339485662720:12345-0@lo:103: Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.975298:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463227.975311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463227.975317:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3648:x1875339485662848:12345-0@lo:103: 00010000:00010000:1.0:1788463227.975324:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.975328:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 16 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975337:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 16 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975348:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975355:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975378:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975385:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975392:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975398:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975404:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207f800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463227.975407:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975415:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975423:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.975432:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463227.975453:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3648:x1875339485662848:12345-0@lo:103: Request processed in 137us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.975460:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463227.975505:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485662848:0@lo:103: 00000100:00100000:1.0:1788463227.975513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485662720:0@lo:103: 00010000:00010000:2.0:1788463227.975619:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207fa00/0x841acb7f42a393e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a393de expref: 15 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.975637:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485662464:0@lo:104: 00010000:00010000:2.0:1788463227.975649:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030a00/0x841acb7f42a3936e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39367 expref: 14 pid: 6516 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463227.975656:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485662592:0@lo:104: 00010000:00010000:2.0:1788463227.975675:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.975685:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.975692:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.975698:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207f800/0x841acb7f42a394a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463227.975711:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788463227.979145:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:8432:x1875339485661568:12345-0@lo:253: Request processed in 14197us (14729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.979160:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463227.979172:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485661568:0@lo:253: 10000000:01000000:1.0:1788463227.979210:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788463227.979213:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463227.979215:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463227.979216:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463227.979217:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788463227.979219:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463227.979220:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463227.979221:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463227.979222:0:8432:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788463227.979223:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463227.979224:0:8432:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788463227.979247:0:8432:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96188f7d1000 from lustre-OST0000 10000000:01000000:1.0:1788463227.979274:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788463227.979276:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788463227.979293:0:8432:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff961884ff19c0 local copy 10000000:01000000:1.0:1788463227.979296:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463227.979328:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.979339:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.979347:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.979363:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485662976:0@lo:101: 00000100:00100000:1.0:1788463227.979396:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.979429:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463227.979446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485662976 00000100:00100000:2.0:1788463227.979454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485662976 00000100:00100000:2.0:1788463227.979552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788463227.979561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+13:8432:x1875339485662976:12345-0@lo:101: 00010000:00010000:2.0:1788463227.979600:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463227.979615:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c207e800/0x841acb7f42a394b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a394a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.979650:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207e800/0x841acb7f42a394b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a394a9 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.979660:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c207e800/0x841acb7f42a394b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394a9 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.979670:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c207e800, rc 0) 00000100:00100000:2.0:1788463227.979707:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485662976:12345-0@lo:101: Request processed in 148us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.979714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463227.979739:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485662976:0@lo:101: 00010000:00010000:1.0:1788463227.979751:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.979772:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.979851:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663104:0@lo:501: 00000100:00100000:1.0:1788463227.979876:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.985396:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463227.985448:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663104 00000100:00100000:2.0:1788463227.985458:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663104 00000100:00100000:2.0:1788463227.985518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463227.985542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663104:12345-0@lo:501: 00000100:00100000:2.0:1788463227.986212:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663104:12345-0@lo:501: Request processed in 682us (6332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463227.986222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788463227.986466:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663104:0@lo:501: 10000000:01000000:1.0:1788463227.986488:0:8432:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788463227.986513:0:8432:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788463227.986522:0:8432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.986544:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.986552:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.986908:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788463227.986945:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96188f7d1000 10000000:01000000:1.0:1788463227.986951:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463227.986957:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788463227.986960:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463227.986964:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788463227.986966:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463227.987013:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.987043:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.987054:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.987074:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663232:0@lo:101: 00000100:00100000:1.0:1788463227.987115:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.987144:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb480 going to sleep for 11 seconds 00010000:00010000:2.0:1788463227.987450:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463227.987458:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.987467:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463227.987471:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.987480:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463227.987499:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463227.987504:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463227.987523:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.987538:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788463227.987595:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485663360:0@lo:103: 00000100:00100000:1.0:1788463227.987623:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463227.987869:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.987878:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a394a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a394b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.987894:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463227.987896:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463227.987898:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463227.987912:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663232 00000100:00100000:2.0:1788463227.987918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663232 00000100:00100000:2.0:1788463227.987954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463227.987961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663232:12345-0@lo:101: 00010000:00010000:2.0:1788463227.987983:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463227.988869:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a394b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.988903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.988916:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463227.988937:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:2.0:1788463227.989002:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485663232:12345-0@lo:101: Request processed in 1040us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.989010:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463227.989468:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663360 00000100:00100000:1.0:1788463227.989476:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663360 00000100:00100000:1.0:1788463227.989530:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463227.989540:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3650:x1875339485663360:12345-0@lo:103: 00010000:00010000:1.0:1788463227.989550:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463227.989564:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207e800/0x841acb7f42a394b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a394a9 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.989823:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463227.989898:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3650:x1875339485663360:12345-0@lo:103: Request processed in 360us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463227.989905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463227.989947:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663232:0@lo:101: 00010000:00010000:1.0:1788463227.989965:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463227.990008:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463227.990114:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663488:0@lo:501: 00000100:00100000:1.0:1788463227.990150:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.990177:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463227.990386:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485663360:0@lo:103: 00000100:00100000:2.0:1788463227.990408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663488 00000100:00100000:2.0:1788463227.990412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663488 00000100:00100000:2.0:1788463227.990435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463227.990441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663488:12345-0@lo:501: 00000100:00100000:2.0:1788463227.990566:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663488:12345-0@lo:501: Request processed in 125us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.990600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788463227.991099:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663488:0@lo:501: 00000100:00100000:1.0:1788463227.991141:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663616:0@lo:503: 00000100:00100000:1.0:1788463227.991183:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.991315:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463227.991343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663616 00000100:00100000:2.0:1788463227.991347:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663616 00000100:00100000:2.0:1788463227.991378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463227.991384:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663616:12345-0@lo:503: 00000100:00100000:2.0:1788463227.991490:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663616:12345-0@lo:503: Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.991496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788463227.991545:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663616:0@lo:503: 00000040:00080000:1.0:1788463227.992166:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463227.992337:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663744:0@lo:502: 00000100:00100000:1.0:1788463227.992379:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.992413:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463227.992522:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663744 00000100:00100000:3.0:1788463227.992528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663744 00000100:00100000:3.0:1788463227.992571:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463227.992600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663744:12345-0@lo:502: 00000100:00100000:3.0:1788463227.992709:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663744:12345-0@lo:502: Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463227.992716:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463227.992807:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663744:0@lo:502: 00000040:00080000:1.0:1788463227.993372:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788463227.993400:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788463227.993416:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788463227.993428:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788463227.993440:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788463227.993453:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788463227.993477:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663872:0@lo:502: 00000100:00100000:1.0:1788463227.993522:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463227.993655:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463227.996560:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485663872 00000100:00100000:2.0:1788463227.996598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485663872 00000100:00100000:2.0:1788463227.997034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463227.997046:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663872:12345-0@lo:502: 00000100:00100000:2.0:1788463227.997222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485663872:12345-0@lo:502: Request processed in 179us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463227.997236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788463227.997511:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485663872:0@lo:502: 00000040:00080000:1.0:1788463227.997680:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788463227.997694:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788463227.998439:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463227.998447:0:8456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788463227.998453:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463227.998455:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788463227.998460:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463227.998474:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96188f9bb380) 00000020:00000080:2.0:1788463227.998494:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788463227.998499:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463227.998568:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f7d1000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788463227.998606:0:8456:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463227.998613:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a394cc 00010000:00010000:2.0:1788463228.007302:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788463228.007871:0:8456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788463228.012623:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788463228.013428:0:8456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788463228.019156:0:8456:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788463228.019369:0:8456:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788463228.026462:0:8456:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788463228.030195:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788463228.030209:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463228.030216:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463228.030218:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788463228.030222:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463228.030226:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463228.030227:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463228.030230:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463228.030232:0:8456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463228.030260:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463228.030264:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463228.030265:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463228.030269:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788463228.030390:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788463228.030427:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788463228.030461:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.030474:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463228.030482:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f7d1000 from 1 10000000:01000000:1.0:1788463228.030484:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463228.030520:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.030528:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.030539:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463228.030561:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664000:0@lo:101: 00000100:00100000:1.0:1788463228.030666:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.030717:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.030774:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664000 00000100:00100000:3.0:1788463228.030782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664000 00000100:00100000:3.0:1788463228.030836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788463228.030847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:8432:x1875339485664000:12345-0@lo:101: 00010000:00010000:3.0:1788463228.030875:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463228.030887:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a394d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463228.030915:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463228.030927:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463228.030936:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f600, rc 0) 00000100:00100000:3.0:1788463228.030993:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664000:12345-0@lo:101: Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.031000:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788463228.031151:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664000:0@lo:101: 00010000:00010000:1.0:1788463228.031167:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.031178:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463228.031293:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664128:0@lo:501: 00000100:00100000:1.0:1788463228.031325:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.031353:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.031416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664128 00000100:00100000:3.0:1788463228.031421:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664128 00000100:00100000:3.0:1788463228.031456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463228.031464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664128:12345-0@lo:501: 00000100:00100000:3.0:1788463228.031564:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664128:12345-0@lo:501: Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.031571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788463228.033543:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664128:0@lo:501: 00000100:00100000:1.0:1788463228.033611:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664256:0@lo:503: 00000100:00100000:1.0:1788463228.033668:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.033704:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463228.034060:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664256 00000100:00100000:0.0:1788463228.034068:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664256 00000100:00100000:0.0:1788463228.034234:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463228.034244:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664256:12345-0@lo:503: 00000100:00100000:0.0:1788463228.034368:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664256:12345-0@lo:503: Request processed in 125us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.034382:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463228.034539:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664256:0@lo:503: 00000040:00080000:1.0:1788463228.034787:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463228.034852:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664384:0@lo:502: 00000100:00100000:1.0:1788463228.034905:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.034926:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.035021:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664384 00000100:00100000:3.0:1788463228.035026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664384 00000100:00100000:3.0:1788463228.035061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463228.035069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664384:12345-0@lo:502: 00000100:00100000:3.0:1788463228.035169:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664384:12345-0@lo:502: Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.035177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463228.035564:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664384:0@lo:502: 00000040:00080000:1.0:1788463228.035771:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788463228.035796:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788463228.035831:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664512:0@lo:502: 00000100:00100000:1.0:1788463228.036146:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.040987:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463228.041113:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664512 00000100:00100000:0.0:1788463228.041123:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664512 00000100:00100000:0.0:1788463228.041188:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788463228.041199:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664512:12345-0@lo:502: 00000100:00100000:0.0:1788463228.041372:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664512:12345-0@lo:502: Request processed in 175us (5225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.041380:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788463228.041455:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664512:0@lo:502: 00000040:00080000:0.0:1788463228.041551:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788463228.041565:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788463228.045796:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463228.045808:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463228.045811:0:8460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788463228.045819:0:8460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188f7d1000 00000020:00000080:1.0:1788463228.045821:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463228.045832:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463228.045834:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463228.045849:0:8460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788463228.045852:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788463228.046021:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788463228.046049:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463228.046074:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046085:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463228.046133:0:8432:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788463228.046136:0:8432:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96188f7d1000 10000000:01000000:0.0:1788463228.046139:0:8432:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96188f7d1000 10000000:01000000:0.0:1788463228.046143:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463228.046149:0:8432:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188f7d1000 from 1 10000000:01000000:0.0:1788463228.046153:0:8432:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463228.046193:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046212:0:8432:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046223:0:8432:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463228.046246:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664640:0@lo:101: 00000100:00100000:0.0:1788463228.046327:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.046374:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618864e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463228.046399:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664640 00000100:00100000:0.0:1788463228.046407:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664640 00000100:00100000:0.0:1788463228.046456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788463228.046464:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8432:x1875339485664640:12345-0@lo:101: 00010000:00010000:0.0:1788463228.046478:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463228.046490:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a394e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046515:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046526:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046534:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5000, rc 0) 00000100:00100000:0.0:1788463228.046594:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485664640:12345-0@lo:101: Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.046602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788463228.046648:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664640:0@lo:101: 00010000:00010000:0.0:1788463228.046674:0:8432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463228.046684:0:8432:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463228.046765:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664768:0@lo:501: 00000100:00100000:0.0:1788463228.046790:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.046823:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618864e4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.046980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664768 00000100:00100000:3.0:1788463228.046984:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664768 00000100:00100000:3.0:1788463228.047015:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788463228.047021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485664768:12345-0@lo:501: 00000100:00100000:3.0:1788463228.047117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485664768:12345-0@lo:501: Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.047124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463228.047178:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664768:0@lo:501: 00000100:00100000:1.0:1788463228.047201:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664896:0@lo:503: 00000100:00100000:1.0:1788463228.047235:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.047254:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.047383:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485664896 00000100:00100000:3.0:1788463228.047387:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485664896 00000100:00100000:3.0:1788463228.047412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463228.047418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485664896:12345-0@lo:503: 00000100:00100000:3.0:1788463228.047489:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485664896:12345-0@lo:503: Request processed in 70us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.047495:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463228.047563:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485664896:0@lo:503: 00000040:00080000:1.0:1788463228.047790:0:8432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463228.047839:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485665024:0@lo:502: 00000100:00100000:1.0:1788463228.047886:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.047900:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463228.048021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665024 00000100:00100000:0.0:1788463228.048025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665024 00000100:00100000:0.0:1788463228.048043:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788463228.048050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485665024:12345-0@lo:502: 00000100:00100000:0.0:1788463228.048129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485665024:12345-0@lo:502: Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.048135:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463228.048354:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485665024:0@lo:502: 00000040:00080000:1.0:1788463228.048501:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788463228.048526:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788463228.048541:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788463228.048554:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788463228.048567:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788463228.048614:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788463228.048638:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788463228.048649:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788463228.048659:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788463228.048669:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788463228.048680:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788463228.048690:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788463228.048700:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788463228.048710:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788463228.048720:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788463228.048730:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788463228.048741:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788463228.048766:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788463228.048779:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788463228.048791:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788463228.048804:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788463228.048816:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788463228.048837:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788463228.048849:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788463228.049072:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788463228.049089:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788463228.049104:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788463228.049116:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788463228.049128:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788463228.049141:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788463228.049154:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788463228.049166:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788463228.049179:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788463228.049193:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788463228.049204:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788463228.049215:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788463228.049228:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788463228.049254:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485665152:0@lo:502: 00000100:00100000:1.0:1788463228.049310:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.049377:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463228.050637:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665152 00000100:00100000:0.0:1788463228.050649:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665152 00000100:00100000:0.0:1788463228.050709:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788463228.050718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485665152:12345-0@lo:502: 00000100:00100000:0.0:1788463228.050861:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485665152:12345-0@lo:502: Request processed in 143us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.050869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463228.051558:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485665152:0@lo:502: 00000040:00080000:1.0:1788463228.051998:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788463228.052013:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788463228.052899:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788463228.052916:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96188f600000) 00000020:00000080:3.0:1788463228.052937:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788463228.053059:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f7d1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463228.053063:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f7d1000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463228.053066:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f7d1000 3 00010000:00080000:3.0:1788463228.053103:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9617868f3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463228.054759:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788463228.054978:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788463228.055017:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463228.055035:0:8461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x841acb7f42a394f6 00000100:00080000:3.0:1788463228.055045:0:8461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463228.055052:0:8461:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617868f3800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463228.055087:0:8461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf31880 x1875339485665280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463228.055119:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463228.055164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485665280:0@lo:38: 00000100:00100000:1.0:1788463228.055317:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485665536:0@lo:400: 00000100:00100000:1.0:1788463228.055377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.055413:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463228.055419:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485665664:0@lo:400: 00000100:00100000:1.0:1788463228.055465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.055532:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788463228.056142:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788463228.056156:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff96188fbd3380) 00000020:00000080:0.0:1788463228.056177:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788463228.056251:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f7d1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788463228.056255:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f7d1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788463228.056258:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f7d1000 3 00010000:00080000:0.0:1788463228.056297:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188faf1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.153@tcp at head 00000100:00100000:2.0:1788463228.059258:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485665792:0@lo:400: 00000100:00100000:2.0:1788463228.059341:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463228.059383:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463228.059391:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485665408:0@lo:400: 00000100:00100000:2.0:1788463228.059420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463228.059466:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665536 00000100:00100000:2.0:1788463228.059474:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665536 00000100:00100000:2.0:1788463228.059621:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665792 00000100:00100000:2.0:1788463228.059626:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665792 00000100:00100000:2.0:1788463228.059649:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463228.059659:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485665536:12345-0@lo:400: 00010000:00010000:0.0:1788463228.059697:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:2.0:1788463228.059729:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485665536:12345-0@lo:400: Request processed in 72us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.059738:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463228.059758:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463228.059765:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485665792:12345-0@lo:400: 00000100:00100000:2.0:1788463228.059797:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485665792:12345-0@lo:400: Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.059804:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463228.059822:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665664 00000100:00100000:2.0:1788463228.059826:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665664 00000100:00100000:2.0:1788463228.059842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665280 00000100:00100000:2.0:1788463228.059844:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665280 00000100:00100000:2.0:1788463228.059852:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665408 00000100:00100000:2.0:1788463228.059855:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665408 00000100:00100000:2.0:1788463228.059866:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463228.059872:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485665664:12345-0@lo:400: 00000100:00100000:2.0:1788463228.059902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485665664:12345-0@lo:400: Request processed in 30us (4436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.059908:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463228.060129:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463228.060140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485665408:12345-0@lo:400: 00000100:00100000:1.0:1788463228.060177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485665408:12345-0@lo:400: Request processed in 40us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463228.060184:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463228.060197:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463228.060204:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485665280:12345-0@lo:38: 00010000:00080000:2.0:1788463228.060227:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1788463228.060269:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x841acb7f42a39504 00000004:00100000:2.0:1788463228.060296:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463228.060328:0:6524:0:(import.c:65:import_set_state_nolock()) ffff961786883800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463228.060381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875339485665280:12345-0@lo:38: Request processed in 177us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.060397:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788463228.060453:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618843f2d80 x1875339485665664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463228.060467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485665664:0@lo:400: 00000100:00100000:2.0:1788463228.060481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485665536:0@lo:400: 00010000:00080000:1.0:1788463228.060516:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188cf31880 x1875339485665280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463228.060526:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463228.060533:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788463228.060540:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788463228.060545:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788463228.060548:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788463228.060554:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485665280:0@lo:38: 00010000:00080000:2.0:1788463228.060626:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618843f0a80 x1875339485665408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463228.060638:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485665408:0@lo:400: 00000100:00100000:2.0:1788463228.060649:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485665792:0@lo:400: 00000020:00000080:0.0:1788463228.062885:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788463228.062950:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463228.062964:0:8461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x841acb7f42a3950b 00000100:00080000:0.0:1788463228.062975:0:8461:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463228.062981:0:8461:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff96188faf1000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463228.063013:0:8461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618843e7480 x1875339485665920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463228.063037:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788463228.063557:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485665920:0@lo:38: 00000100:00100000:1.0:1788463228.063657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.063727:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485665920 00000100:00100000:1.0:1788463228.063736:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485665920 00000100:00100000:1.0:1788463228.063776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463228.063782:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485665920:12345-0@lo:38: 00010000:00080000:1.0:1788463228.064201:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1788463228.064250:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x841acb7f42a39512 00000004:00100000:1.0:1788463228.064266:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463228.064316:0:6522:0:(import.c:65:import_set_state_nolock()) ffff961781da8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463228.064425:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875339485665920:12345-0@lo:38: Request processed in 641us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463228.064442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788463228.064733:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9618843e7480 x1875339485665920/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463228.064746:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463228.064754:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788463228.064761:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463228.064767:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788463228.064769:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188faf1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463228.064776:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485665920:0@lo:38: 00000040:00080000:1.0:1788463228.065208:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788463228.065270:0:8432:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788463228.065314:0:8432:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463228.065329:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.065339:0:8432:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463228.065380:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463228.065383:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463228.065384:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463228.065385:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463228.065387:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463228.065388:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463228.065389:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463228.065390:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463228.065392:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463228.065394:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463228.065395:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463228.065399:0:8432:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788463228.065401:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463228.065403:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463228.065404:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463228.065406:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463228.065407:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463228.065409:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463228.065410:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463228.065411:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463228.065412:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463228.065414:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463228.065415:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463228.065436:0:8432:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788463228.065450:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485666048:0@lo:253: 00000100:00100000:1.0:1788463228.065503:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.065548:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.065904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666048 00000100:00100000:3.0:1788463228.065912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666048 00000100:00100000:3.0:1788463228.065956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788463228.065966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485666048:12345-0@lo:253: 20000000:01000000:3.0:1788463228.065989:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788463228.066002:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788463228.075252:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463228.075273:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788463228.075413:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463228.075419:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463228.075442:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.075461:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.075469:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39424 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.075477:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.075528:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.075542:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 16 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463228.075598:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485666176:0@lo:104: 00000100:00100000:2.0:1788463228.075976:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463228.076021:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.076040:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463228.076049:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485666304:0@lo:104: 00000100:00100000:2.0:1788463228.076069:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463228.076162:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788463228.076181:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463228.076203:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666176 00000100:00100000:3.0:1788463228.076210:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666176 00000100:00100000:1.0:1788463228.076243:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666304 00000100:00100000:1.0:1788463228.076250:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666304 00000100:00100000:3.0:1788463228.076254:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463228.076265:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485666176:12345-0@lo:104: 00010000:00010000:3.0:1788463228.076288:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463228.076352:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463228.076358:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485666176:12345-0@lo:104: Request processed in 96us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.076364:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463228.076398:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463228.076403:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485666304:12345-0@lo:104: 00010000:00010000:3.0:1788463228.076418:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463228.076446:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463228.076451:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485666304:12345-0@lo:104: Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.076456:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463228.076597:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:8432:x1875339485666048:12345-0@lo:253: Request processed in 10632us (11092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.076605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788463228.076747:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485666176:0@lo:104: 00000100:00100000:2.0:1788463228.076760:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485666304:0@lo:104: 00010000:00010000:2.0:1788463228.076779:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.076780:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463228.076801:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.076813:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463228.076820:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.076831:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463228.076840:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463228.076846:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463228.076884:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463228.076890:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:8432:1875339485666048:0@lo:253: 00010000:00010000:1.0:1788463228.076892:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1788463228.076905:0:8432:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788463228.076908:0:8432:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463228.076910:0:8432:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463228.076911:0:8432:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463228.076912:0:8432:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463228.076914:0:8432:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463228.076915:0:8432:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463228.076916:0:8432:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463228.076918:0:8432:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463228.076919:0:8432:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00010000:00010000:1.0:1788463228.076920:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788463228.076921:0:8432:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463228.076924:0:8432:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1788463228.076933:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880031000/0x841acb7f42a39424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3942b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1788463228.076935:0:8432:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788463228.076951:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463228.076957:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.076971:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463228.076974:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.076992:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463228.076998:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463228.077003:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463228.077018:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077033:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463228.077048:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077053:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3940f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077066:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463228.077067:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463228.077069:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463228.077076:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463228.077087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485666560:0@lo:103: 00000100:00100000:1.0:1788463228.077122:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.077161:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666560 00000100:00100000:1.0:1788463228.077165:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666560 00010000:00010000:1.0:1788463228.077190:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463228.077213:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463228.077221:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3649:x1875339485666560:12345-0@lo:103: 00010000:00010000:1.0:1788463228.077230:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463228.077234:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077243:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077271:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00e600/0x841acb7f42a3940f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39408 expref: 16 pid: 6517 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.077297:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463228.077325:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3649:x1875339485666560:12345-0@lo:103: Request processed in 105us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463228.077332:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463228.077353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485666560:0@lo:103: 00010000:00010000:1.0:1788463228.077366:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463228.080153:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485666432:0@lo:103: 00000100:00100000:2.0:1788463228.080223:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463228.080352:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666432 00000100:00100000:1.0:1788463228.080362:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666432 00010000:00010000:1.0:1788463228.080394:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 15 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463228.080443:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463228.080453:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3651:x1875339485666432:12345-0@lo:103: 00010000:00010000:1.0:1788463228.080466:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463228.080481:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 15 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080499:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 15 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080517:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880031400/0x841acb7f42a3942b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39424 expref: 15 pid: 6518 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080533:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080541:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463228.080556:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005137972s 00010000:00010000:1.0:1788463228.080560:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080566:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080610:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080619:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080625:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463228.080631:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.080639:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.080720:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463228.080740:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.081235:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.081255:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21c00/0x841acb7f42a39519 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463228.081272:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463228.081342:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3651:x1875339485666432:12345-0@lo:103: Request processed in 889us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463228.081350:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463228.081384:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485666432:0@lo:103: 00080000:10000000:3.0:1788463228.084248:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788463228.084445:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788463228.084674:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788463228.084810:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788463228.084993:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788463228.085207:0:8432:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788463228.088082:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788463228.098958:0:8432:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788463228.098968:0:8432:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788463228.099020:0:8432:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788463228.099060:0:8432:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788463228.099080:0:8432:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788463228.099109:0:8432:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788463228.099898:0:8432:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463228.100067:0:8432:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788463228.547869:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463229.068201:0:8517:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463229.068496:0:8517:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463229.575301:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463230.597412:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463231.620711:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463231.876211:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485666688:0@lo:41: 00000100:00100000:2.0:1788463231.876292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463231.876603:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666688 00000100:00100000:0.0:1788463231.876626:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666688 00000100:00100000:0.0:1788463231.876740:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463231.876750:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485666688:12345-0@lo:41: 00000004:00000024:0.0:1788463231.876787:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788463231.876860:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485666688:12345-0@lo:41: Request processed in 111us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463231.876867:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463231.877012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485666688:0@lo:41: 00000100:00100000:2.0:1788463232.388755:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485666816:0@lo:41: 00000100:00100000:2.0:1788463232.388835:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463232.388918:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666816 00000100:00100000:2.0:1788463232.388926:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666816 00000100:00100000:2.0:1788463232.388977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463232.388985:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485666816:12345-0@lo:41: 00000004:00000024:2.0:1788463232.389018:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788463232.389063:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485666816:12345-0@lo:41: Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463232.389069:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463232.389114:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485666816:0@lo:41: 00010000:00010000:1.0:1788463232.643928:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463233.422893:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485667328:0@lo:400: 00000100:00100000:3.0:1788463233.423830:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.423912:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788463233.423929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485666944:0@lo:400: 00000100:00100000:3.0:1788463233.424166:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.424205:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485667456:0@lo:400: 00000100:00100000:3.0:1788463233.424234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.424296:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667456 00000100:00100000:3.0:1788463233.424304:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667456 00000100:00100000:3.0:1788463233.424351:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463233.424361:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485667456:12345-0@lo:400: 00000100:00100000:3.0:1788463233.424416:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485667456:12345-0@lo:400: Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.425768:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463233.425838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485667456:0@lo:400: 00000100:00100000:3.0:1788463233.428202:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667328 00000100:00100000:3.0:1788463233.428220:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667328 00000100:00100000:3.0:1788463233.428280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463233.428291:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485667328:12345-0@lo:400: 00000100:00100000:3.0:1788463233.428381:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485667328:12345-0@lo:400: Request processed in 93us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.428388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463233.428419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485667200:0@lo:400: 00000100:00100000:3.0:1788463233.428472:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.428503:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485667712:0@lo:400: 00000100:00100000:3.0:1788463233.428530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.428552:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788463233.428558:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485667072:0@lo:400: 00000100:00100000:3.0:1788463233.428600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.428631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485667584:0@lo:400: 00000100:00100000:3.0:1788463233.428669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.428695:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667200 00000100:00100000:3.0:1788463233.428700:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667200 00000100:00100000:3.0:1788463233.428725:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463233.428732:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485667200:12345-0@lo:400: 00000100:00100000:3.0:1788463233.428767:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485667200:12345-0@lo:400: Request processed in 35us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.428774:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463233.428790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667712 00000100:00100000:3.0:1788463233.428794:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667712 00000100:00100000:3.0:1788463233.428818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667072 00000100:00100000:3.0:1788463233.428821:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667072 00000100:00100000:3.0:1788463233.428831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667584 00000100:00100000:3.0:1788463233.428834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667584 00000100:00100000:3.0:1788463233.428848:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463233.428854:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485667712:12345-0@lo:400: 00000100:00100000:3.0:1788463233.428883:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485667712:12345-0@lo:400: Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.428889:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463233.428899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463233.428905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485667072:12345-0@lo:400: 00000100:00100000:3.0:1788463233.428930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485667072:12345-0@lo:400: Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.428935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463233.428945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463233.428951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485667584:12345-0@lo:400: 00000100:00080000:0.0:1788463233.429548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463233.429553:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463233.431033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485666944 00000100:00100000:2.0:1788463233.431045:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485666944 00000100:00100000:3.0:1788463233.431261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485667584:12345-0@lo:400: Request processed in 2306us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.431279:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788463233.431339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d112d80 x1875339485667072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463233.431353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485667072:0@lo:400: 00010000:00080000:3.0:1788463233.431365:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d112300 x1875339485667584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463233.431372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485667584:0@lo:400: 00000100:00100000:3.0:1788463233.431383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485667200:0@lo:400: 00010000:00080000:3.0:1788463233.431394:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d110380 x1875339485667712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463233.431401:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485667712:0@lo:400: 00000100:00100000:2.0:1788463233.431594:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463233.431604:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3650:x1875339485666944:12345-0@lo:400: 00000100:00100000:2.0:1788463233.431641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:3650:x1875339485666944:12345-0@lo:400: Request processed in 40us (7476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463233.431647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463233.433326:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485666944:0@lo:400: 00010000:00080000:2.0:1788463233.433347:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d113800 x1875339485667328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463233.433359:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485667328:0@lo:400: 00010000:00010000:1.0:1788463233.670138:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463234.676528:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788463234.693884:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788463234.947740:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463234.947748:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188d0ea000 from 30 10000000:01000000:0.0:1788463234.947753:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463234.947799:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.947811:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.947823:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463234.947845:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485667840:0@lo:101: 00000100:00100000:0.0:1788463234.947910:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.947975:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463234.955098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667840 00000100:00100000:3.0:1788463234.955116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667840 00000100:00100000:3.0:1788463234.955295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788463234.955306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:6520:x1875339485667840:12345-0@lo:101: 00010000:00010000:3.0:1788463234.955323:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463234.955340:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39520 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463234.955368:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39520 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463234.955380:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39520 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463234.955408:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f400, rc 0) 00000100:00100000:3.0:1788463234.955778:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485667840:12345-0@lo:101: Request processed in 474us (7866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.955786:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788463234.955907:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485667840:0@lo:101: 00010000:00010000:0.0:1788463234.955926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.955935:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463234.956018:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485667968:0@lo:501: 00000100:00100000:0.0:1788463234.956052:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.956288:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463234.956970:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485667968 00000100:00100000:1.0:1788463234.956978:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485667968 00000100:00100000:1.0:1788463234.957020:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463234.957029:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485667968:12345-0@lo:501: 00000100:00100000:1.0:1788463234.957184:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485667968:12345-0@lo:501: Request processed in 155us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.957192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463234.957352:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485667968:0@lo:501: 00000100:00100000:2.0:1788463234.957390:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668096:0@lo:503: 00000100:00100000:2.0:1788463234.957445:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.957469:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463234.957919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668096 00000100:00100000:1.0:1788463234.957926:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668096 00000100:00100000:1.0:1788463234.957950:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463234.957957:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485668096:12345-0@lo:503: 00000100:00100000:1.0:1788463234.958062:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485668096:12345-0@lo:503: Request processed in 104us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.958069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463234.958162:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668096:0@lo:503: 00000100:00100000:2.0:1788463234.959552:0:8822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8822:1875339485668224:0@lo:502: 00000100:00100000:2.0:1788463234.959655:0:8822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.959686:0:8822:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463234.959874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668224 00000100:00100000:1.0:1788463234.959881:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668224 00000100:00100000:1.0:1788463234.959914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463234.959923:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8822:x1875339485668224:12345-0@lo:502: 00000100:00100000:1.0:1788463234.960026:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8822:x1875339485668224:12345-0@lo:502: Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.960033:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788463234.960131:0:8822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8822:1875339485668224:0@lo:502: 00000100:00100000:2.0:1788463234.960186:0:8822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8822:1875339485668352:0@lo:502: 00000100:00100000:2.0:1788463234.960219:0:8822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.960240:0:8822:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463234.960281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668352 00000100:00100000:1.0:1788463234.960285:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668352 00000100:00100000:1.0:1788463234.960302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463234.960307:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8822:x1875339485668352:12345-0@lo:502: 00000100:00100000:1.0:1788463234.960375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:8822:x1875339485668352:12345-0@lo:502: Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.960381:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788463234.960639:0:8822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8822:1875339485668352:0@lo:502: 00000040:00080000:2.0:1788463234.960658:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788463234.960833:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788463234.960854:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463234.960863:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.960873:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463234.960893:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463234.960896:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188d0ea000 from 5 10000000:01000000:1.0:1788463234.960898:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463234.960924:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.960932:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.960940:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463234.960954:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668480:0@lo:101: 00000100:00100000:1.0:1788463234.960984:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463234.961050:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463234.961130:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668480 00000100:00100000:3.0:1788463234.961135:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668480 00000100:00100000:1.0:1788463234.961348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788463234.961357:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485668480:12345-0@lo:101: 00010000:00010000:1.0:1788463234.961369:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463234.961381:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3952e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.961402:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3952e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.961412:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3952e expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.961420:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813600, rc 0) 00000100:00100000:1.0:1788463234.961480:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485668480:12345-0@lo:101: Request processed in 123us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.961486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788463234.961559:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668480:0@lo:101: 00010000:00010000:0.0:1788463234.961591:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.961600:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463234.961645:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668608:0@lo:256: 00000100:00100000:0.0:1788463234.961678:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.962017:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463234.962073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668608 00000100:00100000:2.0:1788463234.962079:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668608 00000100:00100000:2.0:1788463234.962109:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463234.962116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485668608:12345-0@lo:256: 20000000:01000000:2.0:1788463234.962130:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463234.962158:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463234.962162:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788463234.962248:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485668608:12345-0@lo:256: Request processed in 132us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.962271:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788463234.962390:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668608:0@lo:256: 10000000:01000000:0.0:1788463234.962492:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463234.962498:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.962598:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463234.962606:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788463234.962608:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788463234.962610:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788463234.962629:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.962646:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.962654:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463234.962666:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668736:0@lo:101: 00000100:00100000:0.0:1788463234.962698:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.962719:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463234.962839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668736 00000100:00100000:2.0:1788463234.962843:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668736 00000100:00100000:2.0:1788463234.962861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463234.962867:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485668736:12345-0@lo:101: 00010000:00010000:2.0:1788463234.962874:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463234.962883:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3953c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.962900:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3953c expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.962908:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3953c expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.962915:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20a00, rc 0) 00000100:00100000:2.0:1788463234.962942:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485668736:12345-0@lo:101: Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.962947:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788463234.963065:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668736:0@lo:101: 00010000:00010000:0.0:1788463234.963078:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463234.963086:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463234.963134:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668864:0@lo:501: 00000100:00100000:0.0:1788463234.963170:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.963191:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463234.963379:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668864 00000100:00100000:2.0:1788463234.963384:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668864 00000100:00100000:2.0:1788463234.963415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463234.963421:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485668864:12345-0@lo:501: 00000100:00100000:2.0:1788463234.963691:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485668864:12345-0@lo:501: Request processed in 269us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.963698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788463234.963810:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668864:0@lo:501: 00000100:00100000:0.0:1788463234.963835:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668992:0@lo:503: 00000100:00100000:0.0:1788463234.963875:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.963905:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463234.963945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485668992 00000100:00100000:2.0:1788463234.963949:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485668992 00000100:00100000:2.0:1788463234.963983:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788463234.963991:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485668992:12345-0@lo:503: 00000100:00100000:2.0:1788463234.964072:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485668992:12345-0@lo:503: Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.964078:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788463234.964191:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485668992:0@lo:503: 00000100:00100000:2.0:1788463234.964723:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8823:1875339485669120:0@lo:502: 00000100:00100000:2.0:1788463234.964763:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.964795:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463234.964870:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669120 00000100:00100000:3.0:1788463234.964874:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669120 00000100:00100000:3.0:1788463234.964906:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463234.964914:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:8823:x1875339485669120:12345-0@lo:502: 00000100:00100000:3.0:1788463234.965005:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:8823:x1875339485669120:12345-0@lo:502: Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.965011:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463234.965119:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8823:1875339485669120:0@lo:502: 00000020:01000000:2.0:1788463234.965152:0:8823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463234.965159:0:8823:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788463234.965167:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463234.965169:0:8823:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788463234.965178:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463234.965181:0:8823:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:2.0:1788463234.965202:0:8823:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788463234.965204:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463234.965219:0:8823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff96188f9b8000) 00000020:00000080:2.0:1788463234.965240:0:8823:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788463234.965245:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463234.965400:0:8823:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788463234.965407:0:8823:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788463234.965422:0:8823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a39551 00010000:00080000:2.0:1788463234.965643:0:8823:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188f997800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463234.965855:0:8823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788463234.983848:0:8823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788463234.983874:0:8823:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788463234.984086:0:8823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463234.984343:0:8823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463234.984433:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788463234.984643:0:8823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788463234.985830:0:8824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463234.985836:0:8824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788463234.988034:0:8823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788463234.988048:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788463234.988090:0:8823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788463234.988114:0:8823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a39558 00000100:00080000:2.0:1788463234.988124:0:8823:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463234.988130:0:8823:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff96188f997800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463234.988175:0:8823:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d113800 x1875339485669248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463234.988204:0:8823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788463234.988281:0:8823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463234.988286:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463234.988288:0:8823:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788463234.988291:0:8823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463234.988296:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463234.988297:0:8823:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463234.988300:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463234.988302:0:8823:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788463234.988328:0:8823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8823:1875339485669376:0@lo:502: 00000100:00100000:2.0:1788463234.988405:0:8823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.988442:0:8823:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463234.988771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669376 00000100:00100000:3.0:1788463234.988778:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669376 00000100:00100000:3.0:1788463234.988819:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463234.988829:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:8823:x1875339485669376:12345-0@lo:502: 00000100:00100000:3.0:1788463234.988958:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:8823:x1875339485669376:12345-0@lo:502: Request processed in 130us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.988966:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463234.989009:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485669632:0@lo:400: 00000100:00100000:3.0:1788463234.989042:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.989393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485669504:0@lo:400: 00000100:00100000:2.0:1788463234.989426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.989447:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485670016:0@lo:400: 00000100:00100000:2.0:1788463234.989469:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.989523:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669504 00000100:00100000:2.0:1788463234.989527:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669504 00000100:00100000:2.0:1788463234.989556:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670016 00000100:00100000:2.0:1788463234.989559:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670016 00000100:00100000:2.0:1788463234.989595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463234.989603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485669504:12345-0@lo:400: 00000100:00100000:2.0:1788463234.989641:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485669504:12345-0@lo:400: Request processed in 38us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.989647:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463234.989659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463234.989666:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485670016:12345-0@lo:400: 00000100:00100000:2.0:1788463234.989692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485670016:12345-0@lo:400: Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.989698:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788463234.989732:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf32300 x1875339485669504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463234.989744:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485669504:0@lo:400: 00010000:00080000:2.0:1788463234.989753:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961891628380 x1875339485670016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463234.989761:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485670016:0@lo:400: 00000100:00100000:3.0:1788463234.989892:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485670144:0@lo:400: 00000100:00100000:3.0:1788463234.989920:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463234.989957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485669760:0@lo:400: 00000100:00100000:3.0:1788463234.989991:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463234.990008:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463234.990014:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485669888:0@lo:400: 00000100:00100000:3.0:1788463234.990043:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463234.990075:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669632 00000100:00100000:3.0:1788463234.990079:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669632 00000100:00100000:3.0:1788463234.990104:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669888 00000100:00100000:3.0:1788463234.990106:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669888 00000100:00100000:3.0:1788463234.990119:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788463234.990125:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485669632:12345-0@lo:400: 00000100:00100000:3.0:1788463234.990175:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485669632:12345-0@lo:400: Request processed in 49us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.990181:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788463234.990194:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463234.990199:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485669888:12345-0@lo:400: 00000100:00100000:3.0:1788463234.990228:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485669888:12345-0@lo:400: Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.990234:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463234.990249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670144 00000100:00100000:3.0:1788463234.990252:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670144 00000100:00100000:2.0:1788463234.990347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669760 00000100:00100000:2.0:1788463234.990351:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669760 00000100:00100000:2.0:1788463234.990371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463234.990377:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485669760:12345-0@lo:400: 00000100:00100000:2.0:1788463234.990408:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485669760:12345-0@lo:400: Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.990423:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463234.990750:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485669248:0@lo:8: 00000100:00100000:0.0:1788463234.990792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463234.990890:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485669248 00000100:00100000:1.0:1788463234.990896:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485669248 00000100:00100000:1.0:1788463234.990925:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463234.990931:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485669248:12345-0@lo:8: 00010000:00080000:1.0:1788463234.990956:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1788463234.990985:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3955f 00002000:00100000:1.0:1788463234.991024:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff961781dae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788463234.991028:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788463234.991032:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788463234.991095:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788463234.991333:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788463234.991356:0:8439:0:(import.c:65:import_set_state_nolock()) ffff961781daa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463234.991409:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485669248:12345-0@lo:8: Request processed in 477us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463234.991416:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463234.991667:0:8823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8823:1875339485669376:0@lo:502: 00000020:01000000:2.0:1788463234.991702:0:8823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463234.991709:0:8823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463234.991712:0:8823:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788463234.991716:0:8823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1788463234.991896:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d113800 x1875339485669248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463234.991907:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463234.991923:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788463234.991929:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463234.991934:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788463234.991937:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f997800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463234.992165:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463234.992171:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485669248:0@lo:8: 00000004:00080000:0.0:1788463234.992193:0:8824:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788463234.992247:0:8824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 274443671858ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788463234.992253:0:8824:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788463234.992423:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485670272:0@lo:700: 00000100:00100000:2.0:1788463234.992472:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463234.992506:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463234.992616:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670272 00000100:00100000:0.0:1788463234.992623:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670272 00000100:00100000:0.0:1788463234.992677:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463234.992685:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8825:x1875339485670272:12345-0@lo:700: 00000100:00100000:0.0:1788463234.992717:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875339485670400:0@lo:700: 00000100:00100000:0.0:1788463234.992743:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.992760:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463234.992777:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670400 00000100:00100000:0.0:1788463234.992781:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670400 00000100:00100000:0.0:1788463234.992802:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463234.992806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463234.992807:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875339485670400:12345-0@lo:700: 00000100:00100000:3.0:1788463234.992812:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485670144:12345-0@lo:400: 00000100:00100000:3.0:1788463234.992847:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485670144:12345-0@lo:400: Request processed in 34us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.992853:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463234.992886:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485669888:0@lo:400: 00010000:00080000:3.0:1788463234.992900:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961891629500 x1875339485669760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463234.992920:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485669760:0@lo:400: 00000100:00080000:2.0:1788463234.993121:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463234.993318:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485669632:0@lo:400: 00010000:00080000:3.0:1788463234.993331:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96189162a680 x1875339485670144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463234.993340:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485670144:0@lo:400: 00000020:01000000:1.0:1788463234.993426:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788463234.993453:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788463234.993462:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.993472:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463234.993483:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788463234.993485:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618850d0800 from 30 10000000:01000000:1.0:1788463234.993494:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463234.993616:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.993625:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.993636:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463234.993650:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670528:0@lo:101: 00000100:00100000:1.0:1788463234.993689:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463234.993725:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463234.993731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670528 00000100:00100000:2.0:1788463234.993737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670528 00000100:00100000:2.0:1788463234.993779:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788463234.993787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485670528:12345-0@lo:101: 00010000:00010000:2.0:1788463234.993797:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463234.993810:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.993835:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39566 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.993845:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39566 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463234.993854:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20600, rc 0) 00000100:00100000:2.0:1788463234.993893:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485670528:12345-0@lo:101: Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.993898:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788463234.994683:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670528:0@lo:101: 00010000:00010000:1.0:1788463234.994699:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463234.994708:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463234.994766:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670656:0@lo:501: 00000100:00100000:1.0:1788463234.994796:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463234.994828:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463234.995094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670656 00000100:00100000:0.0:1788463234.995099:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670656 00000100:00100000:0.0:1788463234.995138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463234.995166:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485670656:12345-0@lo:501: 00000100:00100000:0.0:1788463234.995755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485670656:12345-0@lo:501: Request processed in 588us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463234.995762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788463234.996835:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670656:0@lo:501: 00000100:00100000:1.0:1788463234.996888:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670784:0@lo:503: 00000100:00100000:1.0:1788463234.996958:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463234.996998:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463234.997078:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670784 00000100:00100000:3.0:1788463234.997085:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670784 00000100:00100000:3.0:1788463234.997181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463234.997191:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485670784:12345-0@lo:503: 00000100:00100000:3.0:1788463234.997306:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485670784:12345-0@lo:503: Request processed in 117us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.997314:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463234.998648:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485670784:0@lo:503: 00000004:00080000:3.0:1788463235.004855:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788463235.005434:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8826:1875339485670912:0@lo:502: 00000100:00100000:1.0:1788463235.005619:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.005715:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.005768:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485670912 00000100:00100000:3.0:1788463235.005776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485670912 00000100:00100000:3.0:1788463235.005863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788463235.005876:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:8826:x1875339485670912:12345-0@lo:502: 00000100:00100000:3.0:1788463235.006094:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:8826:x1875339485670912:12345-0@lo:502: Request processed in 220us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.006102:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788463235.006430:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8826:1875339485670912:0@lo:502: 00000100:00100000:0.0:1788463235.006490:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8826:1875339485671040:0@lo:502: 00000100:00100000:0.0:1788463235.006748:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:0.0:1788463235.006908:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1788463235.007600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671040 00000100:00100000:3.0:1788463235.007609:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671040 00000100:00100000:3.0:1788463235.007655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463235.007665:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:8826:x1875339485671040:12345-0@lo:502: 00000100:00100000:3.0:1788463235.007788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:8826:x1875339485671040:12345-0@lo:502: Request processed in 124us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.007802:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463235.009497:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.009624:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8826:1875339485671040:0@lo:502: 00000040:00080000:3.0:1788463235.009666:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788463235.010752:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788463235.010783:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463235.010794:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.010806:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463235.010817:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463235.010820:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618850d0800 from 5 10000000:01000000:1.0:1788463235.010822:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463235.010859:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.010867:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.010878:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463235.010899:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671168:0@lo:101: 00000100:00100000:1.0:1788463235.011531:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.012024:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671168 00000100:00100000:3.0:1788463235.012034:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671168 00000100:00100000:1.0:1788463235.012054:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.015235:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788463235.015462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485671168:12345-0@lo:101: 00010000:00010000:3.0:1788463235.015483:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463235.016171:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39574 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.016206:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39574 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.016219:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39574 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.016227:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00ea00, rc 0) 00000100:00100000:3.0:1788463235.016392:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485671168:12345-0@lo:101: Request processed in 1142us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.016399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788463235.016649:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671168:0@lo:101: 00010000:00010000:1.0:1788463235.016667:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.016678:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463235.016753:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671296:0@lo:256: 00000100:00100000:1.0:1788463235.016793:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.016831:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.016841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671296 00000100:00100000:3.0:1788463235.016847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671296 00000100:00100000:3.0:1788463235.016890:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788463235.016897:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485671296:12345-0@lo:256: 20000000:01000000:3.0:1788463235.016912:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788463235.016931:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788463235.016935:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788463235.017028:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485671296:12345-0@lo:256: Request processed in 130us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.017035:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788463235.017060:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671296:0@lo:256: 10000000:01000000:1.0:1788463235.017102:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463235.017109:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.017117:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463235.017125:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788463235.017127:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788463235.017130:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463235.017161:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.017169:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463235.017176:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463235.017188:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671424:0@lo:101: 00000100:00100000:1.0:1788463235.017212:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.017230:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.017339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671424 00000100:00100000:3.0:1788463235.017344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671424 00000100:00100000:3.0:1788463235.017376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788463235.017383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485671424:12345-0@lo:101: 00010000:00010000:3.0:1788463235.017390:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463235.017401:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39582 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.017415:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39582 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.017423:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39582 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463235.017430:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00fe00, rc 0) 00000100:00100000:0.0:1788463235.017752:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8447:x1875339485670400:12345-0@lo:700: Request processed in 24942us (25006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463235.017761:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463235.017819:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485671424:12345-0@lo:101: Request processed in 436us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.017825:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1788463235.020476:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843e5180 x1875339485670400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788463250 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463235.020505:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8447:1875339485670400:0@lo:700: 40000000:02000000:1.0:1788463235.020520:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788463235.021244:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671424:0@lo:101: 00010000:00010000:0.0:1788463235.021353:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463235.021367:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463235.021475:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671552:0@lo:501: 00000100:00100000:0.0:1788463235.021622:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463235.021661:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.022529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671552 00000100:00100000:3.0:1788463235.022539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671552 00000100:00100000:3.0:1788463235.022665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788463235.022676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485671552:12345-0@lo:501: 00000100:00100000:3.0:1788463235.022828:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485671552:12345-0@lo:501: Request processed in 154us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.022850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463235.022887:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671552:0@lo:501: 00000100:00100000:0.0:1788463235.022925:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671680:0@lo:503: 00000100:00100000:0.0:1788463235.022977:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463235.023006:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.026759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671680 00000100:00100000:3.0:1788463235.026774:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671680 00000100:00100000:3.0:1788463235.026837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788463235.026847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485671680:12345-0@lo:503: 00000100:00100000:3.0:1788463235.027673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485671680:12345-0@lo:503: Request processed in 824us (4692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.027682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463235.034618:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485671680:0@lo:503: 00000100:00100000:1.0:1788463235.036378:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8828:1875339485671808:0@lo:502: 00000100:00100000:1.0:1788463235.036764:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.036835:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578780 going to sleep for 11 seconds 00000001:00100000:0.0:1788463235.039950:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788463235.040169:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485670272:12345-0@lo:700: Request processed in 47478us (47690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463235.040189:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788463235.040458:0:8825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d112680 x1875339485670272/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463250 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463235.040473:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485670272:0@lo:700: 00000100:00100000:3.0:1788463235.043870:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671808 00000100:00100000:3.0:1788463235.043884:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671808 00000100:00100000:3.0:1788463235.043965:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788463235.043977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:8828:x1875339485671808:12345-0@lo:502: 00000100:00100000:3.0:1788463235.044166:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:8828:x1875339485671808:12345-0@lo:502: Request processed in 190us (7401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.044174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788463235.044301:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8828:1875339485671808:0@lo:502: 00000020:01000000:1.0:1788463235.044337:0:8828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463235.044347:0:8828:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788463235.044354:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463235.044357:0:8828:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788463235.044362:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463235.044366:0:8828:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:1.0:1788463235.044390:0:8828:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788463235.044393:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463235.044407:0:8828:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96189165b380) 00000020:00000080:1.0:1788463235.044428:0:8828:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788463235.044445:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463235.044543:0:8828:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788463235.044549:0:8828:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788463235.044557:0:8828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a39597 00010000:00080000:1.0:1788463235.044619:0:8828:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188d3ba800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463235.044834:0:8828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:1.0:1788463235.056732:0:8825:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788463235.056780:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672064:0@lo:7: 00000100:00100000:1.0:1788463235.056865:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.056915:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.057237:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485671936:0@lo:13: 00000100:00100000:3.0:1788463235.057405:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788463235.057661:0:8828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788463235.057679:0:8828:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788463235.057877:0:8828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463235.058088:0:8828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463235.058187:0:8828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788463235.058298:0:8828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1788463235.058645:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672064 00000100:00100000:2.0:1788463235.058655:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672064 00000100:00100000:2.0:1788463235.058705:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463235.058714:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485672064:12345-0@lo:7: 00000100:00100000:0.0:1788463235.062254:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485671936 00000100:00100000:0.0:1788463235.062271:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485671936 00000100:00100000:0.0:1788463235.062329:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463235.062339:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485671936:12345-0@lo:13: 00002000:00000024:0.0:1788463235.062369:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923894272 avail 3692371968 00000100:00100000:0.0:1788463235.062464:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485671936:12345-0@lo:13: Request processed in 127us (5058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463235.062471:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788463235.062849:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843f0700 x1875339485671936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463235.062871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485671936:0@lo:13: 00000040:00080000:0.0:1788463235.065486:0:8829:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463235.065492:0:8829:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00002000:00080000:2.0:1788463235.069228:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788463235.069237:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788463235.069329:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485672064:12345-0@lo:7: Request processed in 10612us (12461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463235.069339:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788463235.070118:0:8825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843f3800 x1875339485672064/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463235.070133:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672064:0@lo:7: 00000004:00080000:3.0:1788463235.070159:0:8825:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788463235.070199:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672192:0@lo:5: 00000100:00100000:3.0:1788463235.070250:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.070294:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463235.072664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672192 00000100:00100000:0.0:1788463235.072680:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672192 00000100:00100000:0.0:1788463235.072757:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463235.072767:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485672192:12345-0@lo:5: 00002000:00080000:0.0:1788463235.072799:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788463235.072868:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485672192:12345-0@lo:5: Request processed in 102us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463235.072875:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788463235.073129:0:8825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188f9dce00 x1875339485672192/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463235.073164:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672192:0@lo:5: 00000004:00080000:3.0:1788463235.073179:0:8825:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788463235.073217:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672320:0@lo:5: 00000100:00100000:3.0:1788463235.073248:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.073298:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463235.073782:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672320 00000100:00100000:0.0:1788463235.073803:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672320 00000100:00100000:0.0:1788463235.073835:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463235.073842:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8825:x1875339485672320:12345-0@lo:5: 00002000:00080000:0.0:1788463235.073871:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788463235.082866:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8825:x1875339485672320:12345-0@lo:5: Request processed in 9016us (9609us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788463235.082881:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788463235.082931:0:8825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188f9dce00 x1875339485672320/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463235.082948:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8825:1875339485672320:0@lo:5: 00000004:00080000:3.0:1788463235.082963:0:8825:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788463235.083004:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8825:1875339485672448:0@lo:900: 00000100:00100000:3.0:1788463235.083038:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.083063:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.083088:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672448 00000100:00100000:3.0:1788463235.083093:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672448 00000100:00100000:3.0:1788463235.083134:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463235.083155:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8825:x1875339485672448:12345-0@lo:900: 00000100:00100000:3.0:1788463235.083198:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8825:x1875339485672448:12345-0@lo:900: Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.083219:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788463235.083247:0:8825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188f9de680 x1875339485672448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463235.083256:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8825:1875339485672448:0@lo:900: 00000020:00000080:0.0:1788463235.085129:0:8828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788463235.085154:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463235.085203:0:8828:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788463235.085226:0:8828:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3959e 00000100:00080000:0.0:1788463235.085237:0:8828:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463235.085243:0:8828:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188d3ba800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463235.085376:0:8828:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618843e4e00 x1875339485672576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463235.085443:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485672576:0@lo:8: 00000100:00100000:1.0:1788463235.085520:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.085621:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672576 00000100:00100000:3.0:1788463235.085628:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672576 00000100:00100000:3.0:1788463235.085659:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463235.085666:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3647:x1875339485672576:12345-0@lo:8: 00010000:00080000:3.0:1788463235.085690:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:3.0:1788463235.085716:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a395a5 00002000:00100000:3.0:1788463235.085728:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9617868f0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788463235.085732:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788463235.085735:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788463235.085801:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463235.085823:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9617868f1800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788463235.085897:0:8828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788463235.085963:0:8828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463235.085968:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463235.085971:0:8828:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788463235.085974:0:8828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463235.085977:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463235.085979:0:8828:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463235.085981:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463235.085983:0:8828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788463235.086009:0:8828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8828:1875339485672704:0@lo:502: 00000100:00100000:0.0:1788463235.086061:0:8828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463235.086105:0:8828:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463235.086185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672704 00000100:00100000:2.0:1788463235.086190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672704 00000100:00100000:2.0:1788463235.086230:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788463235.086237:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:8828:x1875339485672704:12345-0@lo:502: 00000100:00100000:2.0:1788463235.086355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:8828:x1875339485672704:12345-0@lo:502: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463235.086363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788463235.086413:0:8828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:8828:1875339485672704:0@lo:502: 00000020:01000000:2.0:1788463235.086435:0:8828:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463235.086439:0:8828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463235.086440:0:8828:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788463235.086444:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788463235.086492:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788463235.086513:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788463235.086522:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086533:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463235.086554:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788463235.086557:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff961884ff19c0 from 1 10000000:01000000:2.0:1788463235.086559:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788463235.086607:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086614:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086623:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463235.086647:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485672832:0@lo:101: 00000100:00100000:2.0:1788463235.086677:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463235.086699:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889cafa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463235.086713:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672832 00000100:00100000:2.0:1788463235.086716:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672832 00000100:00100000:2.0:1788463235.086737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788463235.086743:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485672832:12345-0@lo:101: 00010000:00010000:2.0:1788463235.086751:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463235.086763:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a395ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086783:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086792:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086812:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20c00, rc 0) 00000100:00100000:2.0:1788463235.086841:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485672832:12345-0@lo:101: Request processed in 97us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463235.086846:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788463235.086872:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485672832:0@lo:101: 00010000:00010000:2.0:1788463235.086884:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.086892:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463235.087253:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485672960:0@lo:501: 00000100:00100000:2.0:1788463235.087339:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463235.087358:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889cafa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463235.087372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485672960 00000100:00100000:2.0:1788463235.087375:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485672960 00000100:00100000:2.0:1788463235.087395:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788463235.087401:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485672960:12345-0@lo:501: 00000100:00100000:2.0:1788463235.087466:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485672960:12345-0@lo:501: Request processed in 64us (185us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463235.087472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788463235.087500:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485672960:0@lo:501: 10000000:01000000:2.0:1788463235.087523:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788463235.087529:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463235.087549:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463235.090080:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485672576:12345-0@lo:8: Request processed in 4390us (4537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.090092:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788463235.093389:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843e4e00 x1875339485672576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463235.093403:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463235.093414:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788463235.093422:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463235.094761:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788463235.094766:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d3ba800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463235.094844:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463235.094855:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485672576:0@lo:8: 00000004:00080000:2.0:1788463235.094902:0:8829:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788463235.094990:0:8829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 274546414936ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788463235.094997:0:8829:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788463235.100726:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788463235.117547:0:8830:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788463235.117610:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673216:0@lo:7: 00000100:00100000:0.0:1788463235.117678:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463235.117718:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.117870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485673088:0@lo:13: 00000100:00100000:3.0:1788463235.117904:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463235.117940:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673216 00000100:00100000:3.0:1788463235.117947:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673216 00000100:00100000:3.0:1788463235.117998:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463235.118007:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8830:x1875339485673216:12345-0@lo:7: 00000100:00080000:2.0:1788463235.121538:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463235.123185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673088 00000100:00100000:0.0:1788463235.123200:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673088 00000100:00100000:0.0:1788463235.123272:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463235.123285:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485673088:12345-0@lo:13: 00002000:00000024:0.0:1788463235.123314:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1788463235.123405:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485673088:12345-0@lo:13: Request processed in 123us (5500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463235.123412:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788463235.130476:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843e4e00 x1875339485673088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463235.130515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485673088:0@lo:13: 00002000:00080000:3.0:1788463235.140590:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788463235.140604:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788463235.140696:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8830:x1875339485673216:12345-0@lo:7: Request processed in 22686us (23014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.140707:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788463235.141446:0:8830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843e5c00 x1875339485673216/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463235.141461:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673216:0@lo:7: 00000004:00080000:1.0:1788463235.141476:0:8830:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788463235.141526:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673344:0@lo:5: 00000100:00100000:1.0:1788463235.141567:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.141633:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463235.141742:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673344 00000100:00100000:2.0:1788463235.141749:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673344 00000100:00100000:2.0:1788463235.141788:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463235.141796:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8830:x1875339485673344:12345-0@lo:5: 00002000:00080000:2.0:1788463235.141820:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788463235.141823:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1788463235.153923:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:1.0:1788463235.153941:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788463235.153946:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788463235.154332:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8830:x1875339485673344:12345-0@lo:5: Request processed in 12531us (12759us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788463235.154343:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788463235.154366:0:8830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843f3800 x1875339485673344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463235.154378:0:8830:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463235.154386:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673344:0@lo:5: 00000004:00080000:1.0:1788463235.154401:0:8830:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788463235.154475:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673472:0@lo:700: 00000100:00100000:1.0:1788463235.154522:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.154566:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463235.154622:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673472 00000100:00100000:3.0:1788463235.154629:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673472 00000100:00100000:3.0:1788463235.154674:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463235.154683:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8830:x1875339485673472:12345-0@lo:700: 00000100:00100000:3.0:1788463235.165264:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8830:x1875339485673472:12345-0@lo:700: Request processed in 10564us (10723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463235.165280:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788463235.165301:0:8830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843f3800 x1875339485673472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463235.165319:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673472:0@lo:700: 00000004:02000040:1.0:1788463235.171991:0:8830:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788463235.186560:0:8830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673600:0@lo:5: 00000100:00100000:1.0:1788463235.186665:0:8830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463235.186711:0:8830:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f6d2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463235.186734:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673600 00000100:00100000:1.0:1788463235.186741:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673600 00000100:00100000:1.0:1788463235.186791:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463235.186800:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8830:x1875339485673600:12345-0@lo:5: 00002000:00080000:0.0:1788463235.195258:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788463235.195280:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788463235.197407:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8830:x1875339485673600:12345-0@lo:5: Request processed in 10590us (10724us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788463235.197420:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788463235.204489:0:8830:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fbaaa00 x1875339485673600/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463235.204510:0:8830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8830:1875339485673600:0@lo:5: 00000004:00080000:2.0:1788463235.204528:0:8830:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788463235.716909:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463235.792932:0:8867:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463235.793173:0:8867:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1788463236.717523:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788463236.739944:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463237.000542:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485673728:0@lo:41: 00000100:00100000:3.0:1788463237.000656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463237.000996:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673728 00000100:00100000:2.0:1788463237.001009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673728 00000100:00100000:2.0:1788463237.001090:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463237.001100:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485673728:12345-0@lo:41: 00000004:00000024:2.0:1788463237.001153:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788463237.001222:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485673728:12345-0@lo:41: Request processed in 124us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463237.001233:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463237.001315:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485673728:0@lo:41: 00000100:00100000:0.0:1788463237.507887:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485673856:0@lo:41: 00000100:00100000:0.0:1788463237.507964:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463237.514205:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673856 00000100:00100000:3.0:1788463237.514223:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673856 00000100:00100000:3.0:1788463237.514303:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788463237.514313:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485673856:12345-0@lo:41: 00000004:00000024:3.0:1788463237.514351:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788463237.514445:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485673856:12345-0@lo:41: Request processed in 132us (6479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463237.514452:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463237.514633:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485673856:0@lo:41: 00010000:00010000:2.0:1788463237.765422:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463238.773312:0:8969:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463238.774879:0:8969:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463238.787906:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463239.805489:0:9017:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463239.805500:0:9017:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788463239.812956:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463240.068002:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485673984:0@lo:13: 00000100:00100000:2.0:1788463240.068088:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463240.068291:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485673984 00000100:00100000:0.0:1788463240.068299:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485673984 00000100:00100000:0.0:1788463240.068375:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463240.068384:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485673984:12345-0@lo:13: 00002000:00000024:0.0:1788463240.068412:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463240.068461:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485673984:12345-0@lo:13: Request processed in 79us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463240.068468:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788463240.068716:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188f9dd180 x1875339485673984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463240.068727:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788463240.068746:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485673984:0@lo:13: 00000100:00080000:2.0:1788463240.068858:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463240.579889:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485674368:0@lo:400: 00000100:00100000:0.0:1788463240.579970:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463240.580019:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485674880:0@lo:400: 00000100:00100000:0.0:1788463240.580055:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463240.580087:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463240.580093:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485674240:0@lo:400: 00000100:00100000:0.0:1788463240.580114:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463240.580129:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485674752:0@lo:400: 00000100:00100000:0.0:1788463240.580147:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463240.580182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674880 00000100:00100000:0.0:1788463240.580203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674880 00000100:00100000:0.0:1788463240.580250:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674240 00000100:00100000:0.0:1788463240.580253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674240 00000100:00100000:0.0:1788463240.580267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674752 00000100:00100000:0.0:1788463240.580269:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674752 00000100:00100000:0.0:1788463240.580297:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463240.580305:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485674880:12345-0@lo:400: 00000100:00100000:0.0:1788463240.580367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485674880:12345-0@lo:400: Request processed in 62us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463240.580375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463240.580391:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463240.580396:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485674240:12345-0@lo:400: 00000100:00100000:0.0:1788463240.580423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485674240:12345-0@lo:400: Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463240.580429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463240.580440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463240.580446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485674752:12345-0@lo:400: 00000100:00100000:0.0:1788463240.580471:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485674752:12345-0@lo:400: Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463240.580477:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788463240.580502:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463240.580506:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788463240.580538:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9618843e4e00 x1875339485674240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463240.580552:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485674240:0@lo:400: 00010000:00080000:0.0:1788463240.580563:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c1f80 x1875339485674752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463240.580571:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485674752:0@lo:400: 00010000:00080000:0.0:1788463240.580606:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c1180 x1875339485674880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463240.580627:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485674880:0@lo:400: 00000100:00100000:1.0:1788463240.581242:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485674112:0@lo:400: 00000100:00100000:1.0:1788463240.581287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.581331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485674624:0@lo:400: 00000100:00100000:1.0:1788463240.581359:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.581377:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485675136:0@lo:400: 00000100:00100000:1.0:1788463240.581398:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.581421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788463240.581427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485674496:0@lo:400: 00000100:00100000:1.0:1788463240.581448:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.581465:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485675008:0@lo:400: 00000100:00100000:1.0:1788463240.581498:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.581543:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675136 00000100:00100000:1.0:1788463240.581548:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675136 00000100:00100000:1.0:1788463240.581612:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675008 00000100:00100000:1.0:1788463240.581616:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675008 00000100:00100000:1.0:1788463240.581643:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463240.581650:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485675136:12345-0@lo:400: 00000100:00100000:1.0:1788463240.581689:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485675136:12345-0@lo:400: Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463240.581695:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463240.581709:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463240.581714:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485675008:12345-0@lo:400: 00000100:00100000:1.0:1788463240.581740:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485675008:12345-0@lo:400: Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463240.581745:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788463240.581763:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463240.581784:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c0380 x1875339485675008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463240.581794:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485675008:0@lo:400: 00010000:00080000:1.0:1788463240.581804:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2a00 x1875339485675136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463240.581812:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788463240.581822:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485675136:0@lo:400: 00000100:00100000:1.0:1788463240.581840:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674496 00000100:00100000:1.0:1788463240.581843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674496 00000100:00100000:1.0:1788463240.581867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788463240.581875:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485674496:12345-0@lo:400: 00000100:00100000:1.0:1788463240.581927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485674496:12345-0@lo:400: Request processed in 52us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463240.581934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788463240.581959:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2680 x1875339485674496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463240.581968:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485674496:0@lo:400: 00000100:00100000:3.0:1788463240.582185:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674368 00000100:00100000:3.0:1788463240.582196:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674368 00000100:00100000:3.0:1788463240.582231:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674624 00000100:00100000:3.0:1788463240.582235:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674624 00000100:00100000:3.0:1788463240.582248:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463240.582254:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485674368:12345-0@lo:400: 00000100:00100000:3.0:1788463240.582297:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485674368:12345-0@lo:400: Request processed in 43us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463240.582303:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463240.582316:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463240.582322:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485674624:12345-0@lo:400: 00000100:00100000:3.0:1788463240.582356:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485674624:12345-0@lo:400: Request processed in 35us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463240.582361:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463240.582396:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485674624:0@lo:400: 00000100:00100000:3.0:1788463240.582420:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485674368:0@lo:400: 00000100:00100000:0.0:1788463240.583449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485674112 00000100:00100000:0.0:1788463240.583457:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485674112 00000100:00100000:0.0:1788463240.583671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788463240.583681:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3649:x1875339485674112:12345-0@lo:400: 00000100:00100000:0.0:1788463240.583744:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3649:x1875339485674112:12345-0@lo:400: Request processed in 66us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463240.583751:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788463240.584016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485674112:0@lo:400: 00000100:00100000:1.0:1788463240.586253:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463240.586276:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485675264:0@lo:13: 00000100:00100000:1.0:1788463240.586341:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463240.586393:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675264 00000100:00100000:1.0:1788463240.586400:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675264 00000100:00100000:1.0:1788463240.586446:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463240.586455:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485675264:12345-0@lo:13: 00002000:00000024:1.0:1788463240.586476:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463240.586536:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485675264:12345-0@lo:13: Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463240.586543:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463240.586609:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fbaaa00 x1875339485675264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463240.586628:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485675264:0@lo:13: 00010000:00010000:2.0:1788463240.835786:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463241.862154:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463242.119247:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463242.119274:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485675392:0@lo:41: 00000100:00100000:0.0:1788463242.119345:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463242.119500:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675392 00000100:00100000:2.0:1788463242.119510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675392 00000100:00100000:2.0:1788463242.119563:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463242.119601:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485675392:12345-0@lo:41: 00000004:00000024:2.0:1788463242.119636:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788463242.119686:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485675392:12345-0@lo:41: Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463242.119693:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788463242.119777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485675392:0@lo:41: 00000100:00100000:3.0:1788463242.628100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485675520:0@lo:41: 00000100:00100000:3.0:1788463242.628173:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463242.628259:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675520 00000100:00100000:1.0:1788463242.628268:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675520 00000100:00100000:1.0:1788463242.628329:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463242.628339:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485675520:12345-0@lo:41: 00000004:00000024:1.0:1788463242.628371:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788463242.632835:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485675520:12345-0@lo:41: Request processed in 4480us (4644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463242.632858:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463242.638425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485675520:0@lo:41: 00010000:00010000:0.0:1788463242.883826:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463243.913311:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463244.932759:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463245.197048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485675648:0@lo:13: 00000100:00100000:2.0:1788463245.197141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463245.197316:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675648 00000100:00100000:1.0:1788463245.197325:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675648 00000100:00100000:1.0:1788463245.197389:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463245.197400:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485675648:12345-0@lo:13: 00002000:00000024:1.0:1788463245.197429:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463245.197473:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485675648:12345-0@lo:13: Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463245.197480:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788463245.197541:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463245.197609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fbaaa00 x1875339485675648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463245.197641:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485675648:0@lo:13: 00000100:00100000:2.0:1788463245.700336:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485675904:0@lo:400: 00000100:00100000:2.0:1788463245.700420:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700480:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485676416:0@lo:400: 00000100:00100000:2.0:1788463245.700504:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700538:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788463245.700543:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485675776:0@lo:400: 00000100:00100000:2.0:1788463245.700572:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700686:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676288:0@lo:400: 00000100:00100000:2.0:1788463245.700712:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700729:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676800:0@lo:400: 00000100:00100000:2.0:1788463245.700748:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485676032:0@lo:400: 00000100:00100000:2.0:1788463245.700793:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700808:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485676544:0@lo:400: 00000100:00100000:2.0:1788463245.700830:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700845:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463245.700849:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485676160:0@lo:400: 00000100:00100000:2.0:1788463245.700869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485676672:0@lo:400: 00000100:00100000:2.0:1788463245.700898:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.700942:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675904 00000100:00100000:2.0:1788463245.700950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675904 00000100:00100000:2.0:1788463245.700991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676416 00000100:00100000:2.0:1788463245.701001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676416 00000100:00100000:2.0:1788463245.701030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676544 00000100:00100000:2.0:1788463245.701033:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676544 00000100:00100000:2.0:1788463245.701045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676160 00000100:00100000:2.0:1788463245.701047:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676160 00000100:00100000:2.0:1788463245.701061:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463245.701069:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485675904:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701121:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485675904:12345-0@lo:400: Request processed in 52us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701128:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463245.701143:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463245.701148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485676416:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701173:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485676416:12345-0@lo:400: Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463245.701188:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463245.701193:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485676544:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485676544:12345-0@lo:400: Request processed in 41us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463245.701254:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463245.701259:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485676160:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701283:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485676160:12345-0@lo:400: Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463245.701309:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676288 00000100:00100000:2.0:1788463245.701312:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676288 00000100:00100000:2.0:1788463245.701341:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676032 00000100:00100000:2.0:1788463245.701345:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676032 00000100:00100000:2.0:1788463245.701358:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463245.701363:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676288:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701399:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676288:12345-0@lo:400: Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701405:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463245.701416:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463245.701422:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485676032:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701447:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485676032:12345-0@lo:400: Request processed in 26us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701453:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463245.701470:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676800 00000100:00100000:2.0:1788463245.701474:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676800 00000100:00100000:2.0:1788463245.701498:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676672 00000100:00100000:2.0:1788463245.701501:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676672 00000100:00100000:2.0:1788463245.701512:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463245.701518:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676800:12345-0@lo:400: 00000100:00100000:2.0:1788463245.701545:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676800:12345-0@lo:400: Request processed in 28us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.701551:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463245.701561:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463245.701567:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485676672:12345-0@lo:400: 00000100:00100000:2.0:1788463245.702484:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485676672:12345-0@lo:400: Request processed in 911us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.702492:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788463245.702524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463245.702529:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463245.702540:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463245.702772:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676288:0@lo:400: 00010000:00080000:3.0:1788463245.702789:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961786b44380 x1875339485676800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463245.702799:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676800:0@lo:400: 00010000:00080000:3.0:1788463245.702811:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d112d80 x1875339485675904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463245.702818:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485675904:0@lo:400: 00010000:00080000:3.0:1788463245.702841:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961786b46300 x1875339485676416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463245.702849:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485676416:0@lo:400: 00000100:00100000:0.0:1788463245.703014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485675776 00000100:00100000:0.0:1788463245.703021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485675776 00000100:00100000:0.0:1788463245.703052:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788463245.703059:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3651:x1875339485675776:12345-0@lo:400: 00000100:00100000:0.0:1788463245.703101:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3651:x1875339485675776:12345-0@lo:400: Request processed in 42us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463245.703107:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788463245.703146:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485675776:0@lo:400: 00010000:00080000:2.0:1788463245.703217:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf32300 x1875339485676160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463245.703795:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485676160:0@lo:400: 00010000:00080000:2.0:1788463245.703815:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961786b45180 x1875339485676672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463245.703824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485676672:0@lo:400: 00000100:00100000:2.0:1788463245.703836:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485676032:0@lo:400: 00010000:00080000:2.0:1788463245.703847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961786b45f80 x1875339485676544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463245.703854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485676544:0@lo:400: 00000100:00100000:0.0:1788463245.705083:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676928:0@lo:13: 00000100:00100000:0.0:1788463245.705152:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463245.705234:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485676928 00000100:00100000:1.0:1788463245.705242:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485676928 00000100:00100000:1.0:1788463245.705299:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463245.705309:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676928:12345-0@lo:13: 00002000:00000024:1.0:1788463245.705330:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463245.706951:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485676928:12345-0@lo:13: Request processed in 1625us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463245.706963:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788463245.707042:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff961786b45f80 x1875339485676928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463245.707078:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485676928:0@lo:13: 00010000:00010000:2.0:1788463245.981490:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463246.979877:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463247.237018:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485677056:0@lo:41: 00000100:00100000:0.0:1788463247.237091:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463247.237182:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677056 00000100:00100000:3.0:1788463247.237190:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677056 00000100:00100000:3.0:1788463247.237252:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463247.237261:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485677056:12345-0@lo:41: 00000004:00000024:3.0:1788463247.237418:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788463247.244474:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485677056:12345-0@lo:41: Request processed in 7202us (7371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.244490:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463247.245841:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485677056:0@lo:41: 00000100:00100000:1.0:1788463247.750107:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463247.750136:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485677184:0@lo:41: 00000100:00100000:1.0:1788463247.751063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463247.751329:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677184 00000100:00100000:3.0:1788463247.751338:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677184 00000100:00100000:3.0:1788463247.751407:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463247.751417:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485677184:12345-0@lo:41: 00000004:00000024:3.0:1788463247.751456:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788463247.751512:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485677184:12345-0@lo:41: Request processed in 96us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.751519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463247.751566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485677184:0@lo:41: 00010000:00010000:2.0:1788463248.003677:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463249.028024:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.054319:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463250.310208:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485677312:0@lo:13: 00000100:00100000:0.0:1788463250.312182:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.312459:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677312 00000100:00100000:3.0:1788463250.312467:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677312 00000100:00100000:3.0:1788463250.312529:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463250.312538:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485677312:12345-0@lo:13: 00002000:00000024:3.0:1788463250.312569:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463250.312642:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485677312:12345-0@lo:13: Request processed in 105us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463250.312655:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788463250.312703:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c3800 x1875339485677312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463250.312719:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485677312:0@lo:13: 00000100:00080000:0.0:1788463250.312811:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1788463250.568417:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463250.568421:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788463250.568423:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788463250.568555:0:9516:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96188f993000 00000020:01000004:2.0:1788463250.568570:0:9516:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788463250.568601:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788463250.568616:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96188f9bcd40) 00000020:00000080:2.0:1788463250.570456:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788463250.648147:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788463250.648345:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788463250.681900:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788463250.682140:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788463250.682154:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788463250.682166:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a395c1 00000020:01000004:0.0:1788463250.682173:0:9516:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788463250.682194:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788463250.682197:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788463250.682202:0:9516:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788463250.682230:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788463250.682234:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788463250.708702:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788463250.708743:0:9516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788463250.708746:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788463250.708748:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463250.708749:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463250.708750:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463250.708751:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463250.708752:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463250.708754:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463250.708759:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463250.708761:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463250.708762:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463250.708763:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463250.708766:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788463250.708768:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463250.708769:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463250.708770:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463250.708771:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463250.708772:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463250.708773:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463250.708774:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463250.708775:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463250.708775:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463250.708776:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463250.708777:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463250.708803:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788463250.708820:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485677440:0@lo:253: 00000100:00100000:1.0:1788463250.708915:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.708969:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463250.709034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677440 00000100:00100000:0.0:1788463250.709042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677440 00000100:00100000:0.0:1788463250.709100:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788463250.709111:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:9516:x1875339485677440:12345-0@lo:253: 20000000:01000000:0.0:1788463250.709153:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788463250.709158:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788463250.709163:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788463250.709166:0:6518:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788463250.709375:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463250.709516:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788463250.709538:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788463250.709558:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788463250.709564:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788463250.709621:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788463250.709642:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788463250.709799:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788463250.709820:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:1.0:1788463250.709822:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:1.0:1788463250.709850:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788463250.709858:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788463250.709872:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788463250.709877:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:1.0:1788463250.709889:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788463250.709896:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788463250.709907:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788463250.709935:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788463250.710006:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788463250.710017:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:1.0:1788463250.710019:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:1.0:1788463250.710033:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788463250.710047:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788463250.710065:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788463250.710070:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:1.0:1788463250.710082:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788463250.710088:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788463250.710101:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788463250.710114:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788463250.710454:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788463250.710465:0:6518:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.153@tcp 20000000:01000000:1.0:1788463250.710466:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.153@tcp (null) (null) (null) 00000040:00080000:1.0:1788463250.710478:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788463250.710483:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788463250.710493:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788463250.710498:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.153@tcp (null) (null) 00000040:00080000:1.0:1788463250.710509:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788463250.710513:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788463250.710524:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788463250.710536:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788463250.710548:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788463250.710551:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788463250.710554:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788463250.710641:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788463250.710643:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463250.712195:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463250.712249:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463250.712266:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788463250.712436:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788463250.712462:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788463250.712477:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788463250.712488:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788463250.712491:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463250.712958:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463250.712990:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463250.713002:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788463250.713143:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788463250.713164:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788463250.713180:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788463250.713189:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788463250.713197:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463250.713759:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463250.713780:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463250.713797:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788463250.713934:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788463250.713953:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788463250.713967:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788463250.713975:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788463250.713977:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463250.715764:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463250.715805:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463250.715821:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788463250.716373:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788463250.716791:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788463250.716810:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788463250.716822:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788463250.716825:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788463250.717192:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788463250.717845:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788463250.717872:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788463250.717886:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1788463250.717900:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788463250.717921:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717939:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717946:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717953:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39520 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717958:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3953c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717964:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39566 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717983:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39582 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717989:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.717996:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.718037:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.718053:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.718069:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677568:0@lo:104: 00000100:00100000:1.0:1788463250.718133:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463250.718233:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.718241:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 21 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.718248:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677696:0@lo:104: 00000100:00100000:1.0:1788463250.718270:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463250.718860:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.718869:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 21 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.718885:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677824:0@lo:104: 00000100:00100000:1.0:1788463250.718912:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.718953:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677568 00000100:00100000:3.0:1788463250.718959:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677568 00000100:00100000:3.0:1788463250.718995:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677696 00000100:00100000:3.0:1788463250.718998:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677696 00000100:00100000:3.0:1788463250.719011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463250.719018:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485677568:12345-0@lo:104: 00010000:00010000:3.0:1788463250.719030:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.719086:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463250.719092:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485677568:12345-0@lo:104: Request processed in 75us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463250.719106:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463250.719121:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463250.719126:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485677696:12345-0@lo:104: 00010000:00010000:3.0:1788463250.719134:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.719166:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463250.719170:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485677696:12345-0@lo:104: Request processed in 45us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463250.719175:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788463250.719256:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463250.719263:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719286:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463250.719290:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719299:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463250.719305:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463250.719311:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463250.719348:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719355:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463250.719374:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719392:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21400/0x841acb7f42a395ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719403:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463250.719406:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719411:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463250.719413:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719429:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463250.719435:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463250.719440:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463250.719464:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719470:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463250.719486:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813800/0x841acb7f42a39582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.719502:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.719504:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.719505:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.719512:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463250.719518:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463250.719929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485677952:0@lo:103: 00000100:00100000:2.0:1788463250.719968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.720012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485678080:0@lo:103: 00000100:00100000:2.0:1788463250.720035:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.720066:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677952 00000100:00100000:2.0:1788463250.720071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677952 00010000:00010000:2.0:1788463250.720094:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 22 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.720124:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678080 00000100:00100000:2.0:1788463250.720128:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678080 00010000:00010000:2.0:1788463250.720154:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 23 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.720171:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463250.720179:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3650:x1875339485677952:12345-0@lo:103: 00010000:00010000:2.0:1788463250.720189:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463250.720193:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.720203:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.720231:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463250.720260:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3650:x1875339485677952:12345-0@lo:103: Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.720267:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463250.720281:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463250.720287:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3648:x1875339485678080:12345-0@lo:103: 00010000:00010000:2.0:1788463250.720294:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463250.720298:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 22 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.720307:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 22 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.720316:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463250.720346:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3648:x1875339485678080:12345-0@lo:103: Request processed in 59us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.720351:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463250.720642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485678080:0@lo:103: 00000100:00100000:2.0:1788463250.720670:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485677952:0@lo:103: 00010000:00010000:1.0:1788463250.722026:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.722043:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 21 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722057:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678208:0@lo:104: 00000100:00100000:1.0:1788463250.722100:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463250.722119:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.722127:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 21 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722135:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678336:0@lo:104: 00000100:00100000:1.0:1788463250.722157:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463250.722197:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.722205:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 21 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722226:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678464:0@lo:104: 00000100:00100000:1.0:1788463250.722253:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463250.722271:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.722290:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 21 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722299:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678592:0@lo:104: 00000100:00100000:1.0:1788463250.722318:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788463250.722336:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20c00/0x841acb7f42a395b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a395ac expref: 21 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722347:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677568:0@lo:104: 00010000:00010000:1.0:1788463250.722358:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a39589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39582 expref: 20 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.722365:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677696:0@lo:104: 00000100:00100000:0.0:1788463250.722793:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485677824 00000100:00100000:0.0:1788463250.722804:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485677824 00000100:00100000:0.0:1788463250.722888:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788463250.722910:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.722921:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678208 00000100:00100000:0.0:1788463250.722925:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678208 00000100:00100000:0.0:1788463250.722938:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678336 00000100:00100000:0.0:1788463250.722940:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678336 00000100:00100000:0.0:1788463250.722948:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678464 00000100:00100000:0.0:1788463250.722951:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678464 00000100:00100000:0.0:1788463250.722959:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678592 00000100:00100000:0.0:1788463250.722961:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678592 00000100:00100000:0.0:1788463250.722973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463250.722982:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:6518:x1875339485677824:12345-0@lo:104: 00010000:00010000:0.0:1788463250.722998:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.723063:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463250.723069:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:6518:x1875339485677824:12345-0@lo:104: Request processed in 89us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.723076:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463250.723091:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463250.723097:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6518:x1875339485678208:12345-0@lo:104: 00010000:00010000:0.0:1788463250.723106:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.723437:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463250.723443:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:6518:x1875339485678208:12345-0@lo:104: Request processed in 347us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.723450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463250.723464:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463250.723470:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6518:x1875339485678336:12345-0@lo:104: 00010000:00010000:0.0:1788463250.723478:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.723620:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485677824:0@lo:104: 00000100:00100000:2.0:1788463250.723630:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678208:0@lo:104: 00010000:00010000:0.0:1788463250.723692:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463250.723698:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:6518:x1875339485678336:12345-0@lo:104: Request processed in 229us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.723704:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463250.723719:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463250.723725:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617868e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485678464:12345-0@lo:104: 00010000:00010000:0.0:1788463250.723733:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.723760:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788463250.723765:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617868e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6518:x1875339485678464:12345-0@lo:104: Request processed in 41us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.723770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463250.723798:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463250.723804:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485678592:12345-0@lo:104: 00010000:00010000:0.0:1788463250.723811:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.723890:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678336:0@lo:104: 00000100:00100000:2.0:1788463250.723904:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678464:0@lo:104: 00010000:00010000:0.0:1788463250.723943:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788463250.723948:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6518:x1875339485678592:12345-0@lo:104: Request processed in 145us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.723955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788463250.723980:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788463250.723987:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.723994:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463250.723999:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724009:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463250.724017:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463250.724023:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463250.724053:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724060:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788463250.724071:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6518:1875339485678592:0@lo:104: 00010000:00010000:0.0:1788463250.724088:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724096:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882812000/0x841acb7f42a39566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3956d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.724107:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724145:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788463250.724150:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724156:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463250.724159:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724333:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463250.724344:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463250.724349:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463250.724376:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724382:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788463250.724429:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485678848:0@lo:103: 00000100:00100000:2.0:1788463250.724468:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463250.724539:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724547:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a3953c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39543 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724558:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463250.724561:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724595:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463250.724598:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724605:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463250.724611:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463250.724617:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463250.724638:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.724644:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788463250.724662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678848 00000100:00100000:3.0:1788463250.724669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678848 00010000:00010000:3.0:1788463250.724697:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 20 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463250.724722:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463250.724730:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3650:x1875339485678848:12345-0@lo:103: 00010000:00010000:3.0:1788463250.724742:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463250.724747:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 20 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.724750:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463250.724762:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485678976:0@lo:103: 00010000:00010000:3.0:1788463250.724764:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 20 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.724783:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20a00/0x841acb7f42a39543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3953c expref: 20 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.724794:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463250.724796:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463250.724852:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485678848:0@lo:103: 00000100:00100000:3.0:1788463250.724853:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3650:x1875339485678848:12345-0@lo:103: Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463250.724864:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463250.724880:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678976 00000100:00100000:2.0:1788463250.724884:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678976 00010000:00010000:2.0:1788463250.724902:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 19 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.724929:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463250.724935:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3650:x1875339485678976:12345-0@lo:103: 00010000:00010000:2.0:1788463250.724949:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463250.724953:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 19 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.724961:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 19 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.724972:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00f400/0x841acb7f42a39527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39520 expref: 19 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.724981:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463250.725008:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3650:x1875339485678976:12345-0@lo:103: Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.725014:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463250.725061:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485678976:0@lo:103: 00010000:00010000:0.0:1788463250.725328:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725337:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a39520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39527 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725347:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463250.725350:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725356:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463250.725360:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725378:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463250.725384:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463250.725389:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463250.725417:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725423:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463250.725429:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725435:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a394e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725444:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463250.725447:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725453:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463250.725456:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725462:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463250.725469:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463250.725480:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463250.725494:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725500:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463250.725505:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725511:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882812c00/0x841acb7f42a394b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394be expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725525:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463250.725527:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463250.725528:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463250.725542:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485678720:0@lo:103: 00000100:00100000:0.0:1788463250.725622:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463250.725643:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463250.725655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485679104:0@lo:103: 00000100:00100000:0.0:1788463250.725655:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485679232:0@lo:103: 00000100:00100000:0.0:1788463250.725679:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463250.725680:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463250.725709:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.725739:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485678720 00000100:00100000:2.0:1788463250.725744:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485678720 00010000:00010000:2.0:1788463250.725761:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 18 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.725788:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679232 00000100:00100000:2.0:1788463250.725791:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679232 00010000:00010000:2.0:1788463250.725802:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 19 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.725814:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679104 00000100:00100000:0.0:1788463250.725820:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788463250.725827:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679104 00000100:00100000:0.0:1788463250.725835:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3649:x1875339485678720:12345-0@lo:103: 00010000:00010000:2.0:1788463250.725855:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 20 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725857:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463250.725868:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 20 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.725875:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463250.725884:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3649:x1875339485679232:12345-0@lo:103: 00010000:00010000:0.0:1788463250.725888:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 20 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.725896:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463250.725902:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 20 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725904:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20600/0x841acb7f42a3956d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39566 expref: 20 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.725913:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 20 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.725934:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463250.725935:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20400/0x841acb7f42a394be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a394b7 expref: 19 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.725947:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463250.726014:0:6509:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788463250.726022:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788463250.726035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485679232:12345-0@lo:103: Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.726042:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463250.726056:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463250.726063:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3649:x1875339485678720:12345-0@lo:103: Request processed in 231us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.726065:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3648:x1875339485679104:12345-0@lo:103: 00010000:00010000:2.0:1788463250.726076:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788463250.726080:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788463250.726084:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 17 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726094:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 16 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726105:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5000/0x841acb7f42a394e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a394e1 expref: 16 pid: 6516 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726122:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463250.726122:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485678720:0@lo:103: 00000100:00100000:0.0:1788463250.726134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485679232:0@lo:103: 00010000:00010000:2.0:1788463250.726242:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726255:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726262:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726269:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726275:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726284:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463250.726287:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726294:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726314:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.726324:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463250.726349:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3648:x1875339485679104:12345-0@lo:103: Request processed in 287us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.726361:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463250.726383:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485679104:0@lo:103: 00010000:00010000:0.0:1788463250.726437:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.726455:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.726462:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207e200/0x841acb7f42a395c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788463250.726474:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788463250.729206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:9516:x1875339485677440:12345-0@lo:253: Request processed in 20088us (20286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.729227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463250.729378:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485677440:0@lo:253: 10000000:01000000:1.0:1788463250.729403:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788463250.729406:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463250.729407:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463250.729409:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463250.729410:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788463250.729411:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463250.729412:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463250.729413:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463250.729415:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788463250.729416:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463250.729417:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788463250.729439:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96188f993000 from lustre-OST0001 10000000:01000000:1.0:1788463250.729473:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788463250.729476:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788463250.729493:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff961884ff19c0 local copy 10000000:01000000:1.0:1788463250.729496:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463250.729532:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.729544:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.729553:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.729602:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679360:0@lo:101: 00000100:00100000:1.0:1788463250.729639:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.729670:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463250.731300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679360 00000100:00100000:3.0:1788463250.731313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679360 00000100:00100000:3.0:1788463250.731417:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788463250.731427:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+14:9516:x1875339485679360:12345-0@lo:101: 00010000:00010000:3.0:1788463250.731450:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463250.731469:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880031400/0x841acb7f42a395d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a395cf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.731495:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880031400/0x841acb7f42a395d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a395cf expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.731506:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880031400/0x841acb7f42a395d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395cf expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.731516:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031400, rc 0) 00000100:00100000:3.0:1788463250.731629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679360:12345-0@lo:101: Request processed in 203us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463250.731635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788463250.731852:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679360:0@lo:101: 00010000:00010000:1.0:1788463250.731869:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.731880:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.732006:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679488:0@lo:501: 00000100:00100000:1.0:1788463250.732039:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.732406:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.732677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679488 00000100:00100000:2.0:1788463250.732683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679488 00000100:00100000:2.0:1788463250.732717:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788463250.732726:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679488:12345-0@lo:501: 00000100:00100000:2.0:1788463250.732801:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679488:12345-0@lo:501: Request processed in 76us (761us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463250.732809:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788463250.732919:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679488:0@lo:501: 10000000:01000000:1.0:1788463250.732934:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788463250.732955:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788463250.732961:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.732978:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.732986:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.733011:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788463250.733038:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96188f993000 10000000:01000000:1.0:1788463250.733044:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463250.733049:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788463250.733052:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463250.733056:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788463250.733059:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788463250.733080:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.733088:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.733096:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.733112:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679616:0@lo:101: 00000100:00100000:1.0:1788463250.733157:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.733179:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.733763:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679616 00000100:00100000:2.0:1788463250.733771:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679616 00000100:00100000:2.0:1788463250.733874:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788463250.733884:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679616:12345-0@lo:101: 00010000:00010000:2.0:1788463250.733894:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463250.733906:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a395dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.733927:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a395dd expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.733937:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395dd expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.733944:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:2.0:1788463250.734038:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485679616:12345-0@lo:101: Request processed in 155us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.734044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:2.0:1788463250.734081:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463250.734087:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.734094:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463250.734099:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.734107:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463250.734113:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463250.734119:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463250.734150:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.734157:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463250.734183:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.734191:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207e800/0x841acb7f42a395cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x841acb7f42a395d6 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.734205:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.734217:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463250.734220:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463250.734231:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485679744:0@lo:103: 00000100:00100000:2.0:1788463250.734263:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.735645:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679616:0@lo:101: 00010000:00010000:1.0:1788463250.735668:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.735694:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.737937:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679872:0@lo:501: 00000100:00100000:1.0:1788463250.738012:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.738110:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463250.739255:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679872 00000100:00100000:0.0:1788463250.739266:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679872 00000100:00100000:0.0:1788463250.739297:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485679744 00000100:00100000:0.0:1788463250.739301:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485679744 00000100:00100000:0.0:1788463250.739361:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463250.739372:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3650:x1875339485679744:12345-0@lo:103: 00010000:00010000:0.0:1788463250.739405:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463250.739425:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880031400/0x841acb7f42a395d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a395cf expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.739466:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463250.739525:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3650:x1875339485679744:12345-0@lo:103: Request processed in 155us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.739533:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463250.739595:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485679744:0@lo:103: 00000100:00100000:2.0:1788463250.741609:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788463250.741645:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679872:12345-0@lo:501: 00000100:00100000:2.0:1788463250.741915:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485679872:12345-0@lo:501: Request processed in 280us (3902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.741923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788463250.742057:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485679872:0@lo:501: 00000100:00100000:1.0:1788463250.742194:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680000:0@lo:503: 00000100:00100000:1.0:1788463250.742375:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.742543:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463250.742556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680000 00000100:00100000:3.0:1788463250.742565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680000 00000100:00100000:2.0:1788463250.742652:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788463250.742663:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680000:12345-0@lo:503: 00000100:00100000:2.0:1788463250.742761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680000:12345-0@lo:503: Request processed in 100us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.742768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788463250.742832:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680000:0@lo:503: 00000040:00080000:3.0:1788463250.743098:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463250.743162:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680128:0@lo:502: 00000100:00100000:3.0:1788463250.743207:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.743282:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.747478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680128 00000100:00100000:2.0:1788463250.747494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680128 00000100:00100000:2.0:1788463250.747567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788463250.747601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680128:12345-0@lo:502: 00000100:00100000:2.0:1788463250.747773:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680128:12345-0@lo:502: Request processed in 176us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.747782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788463250.747941:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680128:0@lo:502: 00000040:00080000:3.0:1788463250.748201:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788463250.748233:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788463250.748247:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788463250.748260:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788463250.748275:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788463250.748290:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788463250.748325:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680256:0@lo:502: 00000100:00100000:3.0:1788463250.748371:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.748410:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463250.748528:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680256 00000100:00100000:0.0:1788463250.748535:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680256 00000100:00100000:0.0:1788463250.748605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788463250.748617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680256:12345-0@lo:502: 00000100:00100000:0.0:1788463250.748718:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680256:12345-0@lo:502: Request processed in 105us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.748727:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788463250.748764:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680256:0@lo:502: 00000040:00080000:1.0:1788463250.748810:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788463250.748819:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788463250.749332:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463250.749340:0:9528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788463250.749347:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463250.749350:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788463250.749356:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463250.749371:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96188f604d40) 00000020:00000080:3.0:1788463250.749394:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788463250.749401:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788463250.749487:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f993000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788463250.749497:0:9528:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788463250.749504:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a395f2 00010000:00010000:1.0:1788463250.757744:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788463250.758196:0:9528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788463250.764094:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788463250.764938:0:9528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788463250.777867:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788463250.778029:0:9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788463250.792429:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788463250.804890:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788463250.804904:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463250.804910:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463250.804913:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788463250.804918:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463250.804922:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463250.804924:0:9528:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463250.804927:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463250.804929:0:9528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788463250.804965:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463250.804969:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463250.804971:0:9528:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788463250.804974:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788463250.805553:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788463250.805612:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788463250.805635:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.805647:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463250.805656:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f993000 from 1 10000000:01000000:1.0:1788463250.805666:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463250.805707:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.805717:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.805729:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.805754:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680384:0@lo:101: 00000100:00100000:1.0:1788463250.805827:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.805887:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463250.806477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680384 00000100:00100000:0.0:1788463250.806486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680384 00000100:00100000:0.0:1788463250.806550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788463250.806559:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:9516:x1875339485680384:12345-0@lo:101: 00010000:00010000:0.0:1788463250.806591:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463250.806605:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a395f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.806630:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.806642:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463250.806651:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5800, rc 0) 00000100:00100000:0.0:1788463250.806705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680384:12345-0@lo:101: Request processed in 147us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.806711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788463250.807259:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680384:0@lo:101: 00010000:00010000:1.0:1788463250.807277:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.807288:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.807396:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680512:0@lo:501: 00000100:00100000:1.0:1788463250.807443:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.807485:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.808157:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680512 00000100:00100000:2.0:1788463250.808172:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680512 00000100:00100000:2.0:1788463250.808209:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463250.808216:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680512:12345-0@lo:501: 00000100:00100000:2.0:1788463250.808327:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680512:12345-0@lo:501: Request processed in 112us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.808334:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788463250.809721:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680512:0@lo:501: 00000100:00100000:3.0:1788463250.809778:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680640:0@lo:503: 00000100:00100000:3.0:1788463250.809868:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.809907:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.809949:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680640 00000100:00100000:1.0:1788463250.809956:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680640 00000100:00100000:1.0:1788463250.810007:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788463250.810017:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680640:12345-0@lo:503: 00000100:00100000:1.0:1788463250.810130:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680640:12345-0@lo:503: Request processed in 114us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.810146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788463250.810273:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680640:0@lo:503: 00000040:00080000:3.0:1788463250.811657:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463250.811749:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680768:0@lo:502: 00000100:00100000:3.0:1788463250.811816:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.811943:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.814256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680768 00000100:00100000:1.0:1788463250.814271:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680768 00000100:00100000:1.0:1788463250.814334:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788463250.814345:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680768:12345-0@lo:502: 00000100:00100000:1.0:1788463250.815560:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680768:12345-0@lo:502: Request processed in 1211us (3738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.815589:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788463250.816409:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680768:0@lo:502: 00000040:00080000:3.0:1788463250.817858:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788463250.817896:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788463250.817940:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680896:0@lo:502: 00000100:00100000:3.0:1788463250.818009:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.818096:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.818357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485680896 00000100:00100000:2.0:1788463250.818365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485680896 00000100:00100000:2.0:1788463250.818464:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788463250.818474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680896:12345-0@lo:502: 00000100:00100000:2.0:1788463250.818665:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485680896:12345-0@lo:502: Request processed in 192us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.818673:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788463250.818768:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485680896:0@lo:502: 00000040:00080000:3.0:1788463250.818818:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788463250.818827:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:2.0:1788463250.819887:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000000:3.0:1788463250.820051:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463250.820060:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463250.820063:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463250.820070:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188f993000 00000020:00000080:3.0:1788463250.820073:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463250.820084:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463250.820087:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463250.820088:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788463250.820091:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000100:00100000:0.0:1788463250.820238:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485681152:0@lo:400: 00000100:00100000:0.0:1788463250.820290:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.820329:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463250.820334:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485681280:0@lo:400: 00000100:00100000:0.0:1788463250.820361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.820415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681280 00000100:00100000:0.0:1788463250.820421:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681280 00000100:00100000:0.0:1788463250.820476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463250.820486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485681280:12345-0@lo:400: 00000100:00100000:0.0:1788463250.820543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485681280:12345-0@lo:400: Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.820550:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788463250.820623:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727e300 x1875339485681280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463250.820641:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485681280:0@lo:400: 00000100:00100000:2.0:1788463250.820675:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485681408:0@lo:400: 00000100:00100000:0.0:1788463250.820697:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485681536:0@lo:13: 00000100:00100000:2.0:1788463250.820718:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.820734:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.820749:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485681024:0@lo:400: 00000100:00100000:0.0:1788463250.820775:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681536 00000100:00100000:2.0:1788463250.820776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.820782:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681536 00000100:00100000:2.0:1788463250.820814:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681152 00000100:00100000:2.0:1788463250.820819:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681152 00000100:00100000:0.0:1788463250.820826:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463250.820846:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485681536:12345-0@lo:13: 00002000:00000024:0.0:1788463250.820864:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463250.820868:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681408 00000100:00100000:2.0:1788463250.820873:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681408 00000100:00100000:2.0:1788463250.820893:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463250.820902:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485681152:12345-0@lo:400: 00000100:00100000:0.0:1788463250.820909:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485681536:12345-0@lo:13: Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.820924:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788463250.820944:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463250.820973:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2300 x1875339485681536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463250.820988:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485681152:12345-0@lo:400: Request processed in 75us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.820990:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485681536:0@lo:13: 00000100:00100000:2.0:1788463250.821002:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463250.821019:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463250.821026:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485681408:12345-0@lo:400: 00000100:00100000:0.0:1788463250.821276:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485681408:0@lo:400: 00000100:00100000:2.0:1788463250.821439:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485681408:12345-0@lo:400: Request processed in 412us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.821446:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463250.821469:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681024 00000100:00100000:2.0:1788463250.821472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681024 00000100:00100000:2.0:1788463250.821504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463250.821510:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485681024:12345-0@lo:400: 00000100:00100000:2.0:1788463250.821754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485681024:12345-0@lo:400: Request processed in 242us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.821763:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788463250.821764:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727c700 x1875339485681024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463250.821776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485681024:0@lo:400: 00000100:00100000:2.0:1788463250.821802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485681152:0@lo:400: 00000100:00100000:1.0:1788463250.821939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485681792:0@lo:400: 00000100:00100000:1.0:1788463250.821971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.821993:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463250.821998:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485681664:0@lo:400: 00000100:00100000:1.0:1788463250.822019:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.822043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681792 00000100:00100000:1.0:1788463250.822047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681792 00000100:00100000:1.0:1788463250.822080:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681664 00000100:00100000:1.0:1788463250.822083:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681664 00000100:00100000:1.0:1788463250.822098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463250.822104:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485681792:12345-0@lo:400: 00000100:00100000:1.0:1788463250.822149:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485681792:12345-0@lo:400: Request processed in 45us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.822156:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463250.822180:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463250.822187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485681664:12345-0@lo:400: 00000100:00100000:1.0:1788463250.822211:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485681664:12345-0@lo:400: Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.822229:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788463250.822257:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727d180 x1875339485681664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463250.822267:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485681664:0@lo:400: 00010000:00080000:1.0:1788463250.822275:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727c380 x1875339485681792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463250.822282:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485681792:0@lo:400: 00000100:00080000:1.0:1788463250.822297:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463250.822300:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463250.822310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485681920:0@lo:400: 00000100:00100000:1.0:1788463250.822337:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.822365:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485681920 00000100:00100000:1.0:1788463250.822369:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485681920 00000100:00100000:1.0:1788463250.822392:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463250.822398:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485681920:12345-0@lo:400: 00000100:00100000:1.0:1788463250.822437:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485681920:12345-0@lo:400: Request processed in 39us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.822443:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788463250.822486:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727ea00 x1875339485681920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463250.822495:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485681920:0@lo:400: 00000020:01000000:1.0:1788463250.822514:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788463250.822816:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463250.822849:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.822873:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463250.822923:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788463250.822926:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96188f993000 10000000:01000000:1.0:1788463250.822929:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96188f993000 10000000:01000000:1.0:1788463250.822933:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463250.822939:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188f993000 from 1 10000000:01000000:1.0:1788463250.822942:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463250.822971:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.822979:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.822989:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.823005:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682048:0@lo:101: 00000100:00100000:1.0:1788463250.823040:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.823067:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.823087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682048 00000100:00100000:1.0:1788463250.823091:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682048 00000100:00100000:1.0:1788463250.823120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788463250.823309:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9516:x1875339485682048:12345-0@lo:101: 00010000:00010000:1.0:1788463250.823320:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463250.823332:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39607 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.823364:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39607 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.823375:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39607 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.823385:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c207fa00, rc 0) 00000100:00100000:1.0:1788463250.823544:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682048:12345-0@lo:101: Request processed in 239us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.823552:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788463250.823864:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682048:0@lo:101: 00010000:00010000:3.0:1788463250.823882:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.823891:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463250.823982:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682176:0@lo:501: 00000100:00100000:3.0:1788463250.824017:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.824085:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463250.824300:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682176 00000100:00100000:2.0:1788463250.824305:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682176 00000100:00100000:2.0:1788463250.824379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788463250.824388:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682176:12345-0@lo:501: 00000100:00100000:2.0:1788463250.824523:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682176:12345-0@lo:501: Request processed in 136us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.824539:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788463250.824619:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682176:0@lo:501: 00000100:00100000:3.0:1788463250.824650:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682304:0@lo:503: 00000100:00100000:3.0:1788463250.824687:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.825074:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.825144:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682304 00000100:00100000:1.0:1788463250.825149:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682304 00000100:00100000:1.0:1788463250.825181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788463250.825188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682304:12345-0@lo:503: 00000100:00100000:1.0:1788463250.825275:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682304:12345-0@lo:503: Request processed in 87us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.825281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463250.825419:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682304:0@lo:503: 00000040:00080000:3.0:1788463250.825694:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463250.825768:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682432:0@lo:502: 00000100:00100000:3.0:1788463250.825808:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.825831:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.826054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682432 00000100:00100000:1.0:1788463250.826059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682432 00000100:00100000:1.0:1788463250.826078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463250.826084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682432:12345-0@lo:502: 00000100:00100000:1.0:1788463250.826184:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682432:12345-0@lo:502: Request processed in 100us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.826191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788463250.826348:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682432:0@lo:502: 00000040:00080000:3.0:1788463250.826675:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788463250.826705:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788463250.826719:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788463250.826732:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788463250.826746:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788463250.826761:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788463250.826773:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788463250.826785:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788463250.826797:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788463250.826810:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788463250.826823:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788463250.826862:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788463250.826878:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788463250.826891:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788463250.826908:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788463250.826921:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788463250.826933:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788463250.826945:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788463250.826956:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788463250.826981:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788463250.826996:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788463250.827009:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788463250.827023:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788463250.827036:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788463250.827048:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788463250.827060:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788463250.827072:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788463250.827098:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788463250.827115:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788463250.827766:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788463250.827786:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788463250.827797:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788463250.827808:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788463250.827820:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788463250.827831:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788463250.827858:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788463250.827871:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788463250.827883:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788463250.827893:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788463250.827904:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788463250.827916:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788463250.827927:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788463250.827939:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788463250.827967:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788463250.827981:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788463250.827993:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788463250.828034:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682560:0@lo:502: 00000100:00100000:3.0:1788463250.828103:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.828308:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682560 00000100:00100000:2.0:1788463250.828316:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682560 00000100:00100000:2.0:1788463250.828360:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788463250.828368:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682560:12345-0@lo:502: 00000100:00100000:2.0:1788463250.828633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485682560:12345-0@lo:502: Request processed in 265us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.828641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788463250.828891:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463250.828913:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485682560:0@lo:502: 00000040:00080000:3.0:1788463250.828979:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788463250.828989:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788463250.829919:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788463250.829948:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96178790cd40) 00000020:00000080:1.0:1788463250.829974:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788463250.830074:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f993000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788463250.830078:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f993000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788463250.830082:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f993000 3 00010000:00080000:1.0:1788463250.830113:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188faf6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463250.834290:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788463250.834728:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788463250.834774:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788463250.834800:0:9533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x841acb7f42a3961c 00000100:00080000:1.0:1788463250.834813:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463250.834819:0:9533:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96188faf6800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463250.834870:0:9533:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178727d180 x1875339485682688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463250.834896:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463250.834996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485682688:0@lo:38: 00000100:00100000:0.0:1788463250.835078:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.835163:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682688 00000100:00100000:0.0:1788463250.835181:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682688 00000100:00100000:0.0:1788463250.835215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463250.835222:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875339485682688:12345-0@lo:38: 00010000:00080000:0.0:1788463250.835245:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1788463250.835273:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x841acb7f42a39623 00000004:00100000:0.0:1788463250.835287:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788463250.835316:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9618c1ad1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463250.835365:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875339485682688:12345-0@lo:38: Request processed in 142us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.835372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788463250.835409:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727d180 x1875339485682688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463250.835431:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463250.835439:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788463250.835446:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463250.835450:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463250.835453:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463250.835468:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485682688:0@lo:38: 00000020:01000004:0.0:1788463250.836146:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788463250.836160:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff96188fbd0000) 00000100:00100000:1.0:1788463250.836329:0:9534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875339485682816:0@lo:901: 00000100:00100000:1.0:1788463250.836374:0:9534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.836407:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682816 00000100:00100000:1.0:1788463250.836412:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682816 00000100:00100000:1.0:1788463250.836450:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463250.836540:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875339485682816:12345-0@lo:901: 00000100:00100000:1.0:1788463250.836645:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875339485682816:12345-0@lo:901: Request processed in 187us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.836653:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788463250.836671:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463250.836682:0:9534:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f9f63c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788463250.836700:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727f100 x1875339485682816/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788463266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463250.836710:0:9534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875339485682816:0@lo:901: 00000020:00000080:0.0:1788463250.836983:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788463250.837072:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188f993000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463250.837077:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f993000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463250.837080:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f993000 3 00010000:00080000:0.0:1788463250.837107:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188f416800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463250.840537:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788463250.840738:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788463250.840789:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788463250.840803:0:9533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x841acb7f42a39631 00000100:00080000:1.0:1788463250.840814:0:9533:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463250.840820:0:9533:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96188f416800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463250.840872:0:9533:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178727f100 x1875339485682944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463250.840899:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788463250.841677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485682944:0@lo:38: 00000100:00100000:1.0:1788463250.841751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463250.844695:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485682944 00000100:00100000:0.0:1788463250.844708:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485682944 00000100:00100000:0.0:1788463250.844751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463250.844760:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485682944:12345-0@lo:38: 00010000:00080000:0.0:1788463250.844795:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:0.0:1788463250.844832:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x841acb7f42a39638 00000004:00100000:0.0:1788463250.844859:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788463250.844896:0:6524:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463250.844980:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875339485682944:12345-0@lo:38: Request processed in 220us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.844988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788463250.846329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727f100 x1875339485682944/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463250.846343:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463250.846352:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788463250.846360:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788463250.846365:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788463250.846368:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f416800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788463250.846375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485682944:0@lo:38: 00000040:00080000:1.0:1788463250.846645:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788463250.847422:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788463250.847538:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463250.847563:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463250.847600:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788463250.847658:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788463250.847660:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463250.847662:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463250.847663:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463250.847664:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463250.847665:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463250.847667:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463250.847668:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463250.847670:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463250.847672:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463250.847673:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463250.847677:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788463250.847680:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463250.847681:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463250.847683:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463250.847684:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463250.847685:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463250.847686:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463250.847687:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463250.847688:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463250.847689:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463250.847690:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463250.847691:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463250.847717:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788463250.847734:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485683072:0@lo:253: 00000100:00100000:3.0:1788463250.847805:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463250.847865:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463250.852490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683072 00000100:00100000:3.0:1788463250.852506:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683072 00000100:00100000:3.0:1788463250.854361:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788463250.854377:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9516:x1875339485683072:12345-0@lo:253: 20000000:01000000:3.0:1788463250.854412:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788463250.854427:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788463250.861795:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463250.861813:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788463250.861929:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463250.861934:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463250.861955:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.861973:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3952e expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.861982:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39574 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.861990:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.862030:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.862043:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 17 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.862057:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485683200:0@lo:104: 00000100:00100000:2.0:1788463250.862121:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463250.862241:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.862249:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 17 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.862268:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485683328:0@lo:104: 00000100:00100000:2.0:1788463250.862294:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463250.862320:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463250.862370:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683200 00000100:00100000:1.0:1788463250.862378:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683200 00000100:00100000:1.0:1788463250.862412:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683328 00000100:00100000:1.0:1788463250.862415:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683328 00000100:00100000:1.0:1788463250.862429:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463250.862437:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485683200:12345-0@lo:104: 00010000:00010000:1.0:1788463250.862469:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862538:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463250.862544:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:6538:x1875339485683200:12345-0@lo:104: Request processed in 108us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.862551:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463250.862568:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463250.862596:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485683328:12345-0@lo:104: 00010000:00010000:1.0:1788463250.862604:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862638:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463250.862644:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:6538:x1875339485683328:12345-0@lo:104: Request processed in 70us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.862649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788463250.862667:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463250.862674:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862681:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463250.862685:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862694:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463250.862702:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463250.862715:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463250.862745:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862753:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463250.862771:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862779:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813e00/0x841acb7f42a39574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3957b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862795:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463250.862799:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862804:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463250.862807:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862814:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463250.862821:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463250.862826:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463250.862850:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862856:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463250.862879:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862886:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813c00/0x841acb7f42a3952e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39535 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.862902:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463250.862904:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463250.862906:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463250.862913:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463250.862928:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463250.862941:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485683456:0@lo:103: 00000100:00100000:1.0:1788463250.862972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.862999:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463250.863007:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485683584:0@lo:103: 00000100:00100000:1.0:1788463250.863028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463250.863053:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683456 00000100:00100000:1.0:1788463250.863057:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683456 00010000:00010000:1.0:1788463250.863077:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 18 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.863096:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683584 00000100:00100000:1.0:1788463250.863098:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683584 00010000:00010000:1.0:1788463250.863109:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 19 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463250.863125:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463250.863131:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3650:x1875339485683456:12345-0@lo:103: 00010000:00010000:1.0:1788463250.863142:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463250.863147:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 19 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463250.863495:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:9516:x1875339485683072:12345-0@lo:253: Request processed in 9121us (15689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.863504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788463250.863567:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:760a69d7-d23f-4a71-8b75-cca21d577f9e:9516:1875339485683072:0@lo:253: 10000000:01000000:0.0:1788463250.863595:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788463250.863598:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463250.863600:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788463250.863601:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463250.863602:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463250.863604:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463250.863605:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463250.863606:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463250.863608:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788463250.863609:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788463250.863611:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463250.863612:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788463250.863626:0:9516:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788463250.864351:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 19 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864374:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463250.864421:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3650:x1875339485683456:12345-0@lo:103: Request processed in 1289us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.864428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463250.864447:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463250.864514:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3649:x1875339485683584:12345-0@lo:103: 00010000:00010000:1.0:1788463250.864592:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463250.864599:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 17 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864610:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 17 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864621:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864630:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463250.864644:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005137972s 00010000:00010000:1.0:1788463250.864648:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864654:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864660:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864676:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864682:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463250.864686:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864694:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864703:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463250.864711:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463250.864744:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:3649:x1875339485683584:12345-0@lo:103: Request processed in 233us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463250.864750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463250.864799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485683584:0@lo:103: 00000100:00100000:1.0:1788463250.864824:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485683456:0@lo:103: 00010000:00010000:2.0:1788463250.865295:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00ea00/0x841acb7f42a3957b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39574 expref: 16 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.865309:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485683200:0@lo:104: 00010000:00010000:2.0:1788463250.865318:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813600/0x841acb7f42a39535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3952e expref: 15 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463250.865327:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875339485683328:0@lo:104: 00010000:00010000:2.0:1788463250.865345:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.865354:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.865360:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463250.865366:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21400/0x841acb7f42a3963f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788463250.876937:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788463250.877119:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788463250.879408:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788463250.879931:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788463250.880153:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788463250.880403:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788463250.883665:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788463250.895150:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788463250.895173:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788463250.895214:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463250.895258:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463250.895277:0:9516:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788463250.895299:0:9516:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788463250.896142:0:9516:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463250.896335:0:9516:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788463251.076750:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463251.876456:0:9590:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463251.877255:0:9590:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463252.104363:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463252.355790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485683712:0@lo:41: 00000100:00100000:1.0:1788463252.355885:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463252.356076:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683712 00000100:00100000:3.0:1788463252.356085:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683712 00000100:00100000:3.0:1788463252.360598:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463252.360682:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485683712:12345-0@lo:41: 00000004:00000024:3.0:1788463252.360720:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788463252.360794:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485683712:12345-0@lo:41: Request processed in 118us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463252.360800:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463252.360872:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485683712:0@lo:41: 00000100:00100000:1.0:1788463252.872037:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485683840:0@lo:41: 00000100:00100000:1.0:1788463252.872127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463252.872311:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683840 00000100:00100000:2.0:1788463252.872318:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683840 00000100:00100000:2.0:1788463252.872373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463252.872382:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485683840:12345-0@lo:41: 00000004:00000024:2.0:1788463252.872424:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788463252.872469:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485683840:12345-0@lo:41: Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463252.872476:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788463252.872791:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485683840:0@lo:41: 00010000:00010000:2.0:1788463253.124996:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463254.155383:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463255.171993:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463255.428853:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485683968:0@lo:13: 00000100:00100000:1.0:1788463255.428928:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463255.432967:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485683968 00000100:00100000:0.0:1788463255.432984:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485683968 00000100:00100000:0.0:1788463255.433072:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463255.433084:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485683968:12345-0@lo:13: 00002000:00000024:0.0:1788463255.433120:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463255.433205:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485683968:12345-0@lo:13: Request processed in 125us (4277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463255.433213:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788463255.433305:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463255.433366:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c0380 x1875339485683968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463255.433385:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485683968:0@lo:13: 00000100:00100000:2.0:1788463255.940126:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485684096:0@lo:13: 00000100:00100000:2.0:1788463255.940192:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.940268:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684096 00000100:00100000:2.0:1788463255.940276:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684096 00000100:00100000:2.0:1788463255.940332:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463255.940340:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485684096:12345-0@lo:13: 00002000:00000024:2.0:1788463255.940362:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463255.940402:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485684096:12345-0@lo:13: Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463255.940409:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788463255.940427:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463255.940457:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b45880 x1875339485684096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463255.940474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485684096:0@lo:13: 00000100:00100000:2.0:1788463255.942275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485684608:0@lo:400: 00000100:00100000:2.0:1788463255.942335:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.942367:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485685120:0@lo:400: 00000100:00100000:2.0:1788463255.942391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.942423:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788463255.942429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485684224:0@lo:400: 00000100:00100000:2.0:1788463255.942465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.942488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485684736:0@lo:400: 00000100:00100000:2.0:1788463255.942510:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.942527:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485685248:0@lo:400: 00000100:00100000:2.0:1788463255.942553:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.942606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684608 00000100:00100000:2.0:1788463255.942613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684608 00000100:00100000:2.0:1788463255.942657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685248 00000100:00100000:2.0:1788463255.942661:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685248 00000100:00100000:2.0:1788463255.942687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463255.942696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485684608:12345-0@lo:400: 00000100:00100000:2.0:1788463255.942756:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485684608:12345-0@lo:400: Request processed in 60us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463255.942764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463255.942783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463255.942791:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485685248:12345-0@lo:400: 00000100:00100000:2.0:1788463255.942816:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485685248:12345-0@lo:400: Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463255.942822:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463255.942840:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685120 00000100:00100000:2.0:1788463255.942843:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685120 00000100:00100000:2.0:1788463255.942866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463255.942873:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485685120:12345-0@lo:400: 00000100:00100000:2.0:1788463255.942901:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485685120:12345-0@lo:400: Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463255.942907:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463255.943237:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485684480:0@lo:400: 00000100:00100000:1.0:1788463255.943269:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463255.943288:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485684992:0@lo:400: 00000100:00100000:1.0:1788463255.943308:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463255.943326:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463255.943332:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485684352:0@lo:400: 00000100:00100000:1.0:1788463255.943353:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463255.943364:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485684864:0@lo:400: 00000100:00100000:1.0:1788463255.943382:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463255.943392:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485685376:0@lo:400: 00000100:00100000:1.0:1788463255.943410:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463255.944288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684224 00000100:00100000:2.0:1788463255.944303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684224 00000100:00100000:1.0:1788463255.944392:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684736 00000100:00100000:1.0:1788463255.944396:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684736 00000100:00100000:1.0:1788463255.944433:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684480 00000100:00100000:1.0:1788463255.944437:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684480 00000100:00100000:1.0:1788463255.944452:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463255.944459:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485684736:12345-0@lo:400: 00000100:00100000:1.0:1788463255.944520:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485684736:12345-0@lo:400: Request processed in 61us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463255.944527:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463255.944542:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463255.944548:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485684480:12345-0@lo:400: 00000100:00100000:1.0:1788463255.944597:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485684480:12345-0@lo:400: Request processed in 49us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463255.944603:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463255.944638:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485684480:0@lo:400: 00000100:00100000:3.0:1788463255.945088:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684992 00000100:00100000:3.0:1788463255.945094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684992 00000100:00100000:3.0:1788463255.945120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684352 00000100:00100000:3.0:1788463255.945124:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684352 00000100:00100000:3.0:1788463255.945146:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485684864 00000100:00100000:3.0:1788463255.945149:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485684864 00000100:00100000:3.0:1788463255.945162:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685376 00000100:00100000:3.0:1788463255.945165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685376 00000100:00100000:3.0:1788463255.945178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463255.945185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485684992:12345-0@lo:400: 00000100:00100000:3.0:1788463255.945229:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485684992:12345-0@lo:400: Request processed in 44us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463255.945235:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463255.945249:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463255.945254:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485684352:12345-0@lo:400: 00000100:00100000:3.0:1788463255.945283:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485684352:12345-0@lo:400: Request processed in 28us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463255.945289:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463255.945302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463255.945308:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485684864:12345-0@lo:400: 00000100:00100000:3.0:1788463255.945335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485684864:12345-0@lo:400: Request processed in 28us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463255.945341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463255.945352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463255.945358:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485685376:12345-0@lo:400: 00000100:00100000:3.0:1788463255.945385:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485685376:12345-0@lo:400: Request processed in 27us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463255.945390:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788463255.945424:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b46680 x1875339485684352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.945436:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485684352:0@lo:400: 00010000:00080000:3.0:1788463255.945456:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32300 x1875339485684864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.945464:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485684864:0@lo:400: 00010000:00080000:3.0:1788463255.945480:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5f100 x1875339485685376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.945488:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485685376:0@lo:400: 00010000:00080000:3.0:1788463255.945496:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ea00 x1875339485684992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.945502:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485684992:0@lo:400: 00000100:00100000:2.0:1788463255.945805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788463255.945816:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3648:x1875339485684224:12345-0@lo:400: 00000100:00100000:2.0:1788463255.945854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3648:x1875339485684224:12345-0@lo:400: Request processed in 43us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463255.945861:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788463255.946052:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463255.946056:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463255.947725:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485684224:0@lo:400: 00000100:00100000:3.0:1788463255.947760:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485684736:0@lo:400: 00010000:00080000:3.0:1788463255.947782:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ed80 x1875339485685248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.947793:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485685248:0@lo:400: 00010000:00080000:3.0:1788463255.947805:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf30700 x1875339485684608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.947813:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485684608:0@lo:400: 00010000:00080000:3.0:1788463255.947825:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5f480 x1875339485685120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463255.947833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485685120:0@lo:400: 00010000:00010000:2.0:1788463256.195693:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463256.964166:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788463256.964174:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188f7d1000 from 39 10000000:01000000:3.0:1788463256.964188:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788463256.964232:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.964244:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.964255:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.964277:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685504:0@lo:101: 00000100:00100000:3.0:1788463256.964345:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.964415:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.966990:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685504 00000100:00100000:0.0:1788463256.967004:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685504 00000100:00100000:0.0:1788463256.967172:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463256.967184:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485685504:12345-0@lo:101: 00010000:00010000:0.0:1788463256.967202:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463256.967228:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39646 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.967256:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39646 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.967267:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39646 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.967276:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4800, rc 0) 00000100:00100000:0.0:1788463256.967343:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485685504:12345-0@lo:101: Request processed in 162us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.967351:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788463256.968639:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685504:0@lo:101: 00010000:00010000:3.0:1788463256.968665:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.968677:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.968766:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685632:0@lo:501: 00000100:00100000:3.0:1788463256.968815:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.968862:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463256.968879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685632 00000100:00100000:3.0:1788463256.968884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685632 00000100:00100000:3.0:1788463256.968918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788463256.968926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485685632:12345-0@lo:501: 00000100:00100000:3.0:1788463256.969042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485685632:12345-0@lo:501: Request processed in 116us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463256.969059:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788463256.969109:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685632:0@lo:501: 00000100:00100000:3.0:1788463256.969136:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685760:0@lo:503: 00000100:00100000:3.0:1788463256.969173:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.969185:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463256.969194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685760 00000100:00100000:3.0:1788463256.969197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685760 00000100:00100000:3.0:1788463256.969216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788463256.969222:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485685760:12345-0@lo:503: 00000100:00100000:3.0:1788463256.969286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485685760:12345-0@lo:503: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463256.969292:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788463256.969327:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485685760:0@lo:503: 00000100:00100000:3.0:1788463256.969777:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9841:1875339485685888:0@lo:502: 00000100:00100000:3.0:1788463256.969810:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.969828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485685888 00000100:00100000:3.0:1788463256.969831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485685888 00000100:00100000:3.0:1788463256.969864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463256.969871:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9841:x1875339485685888:12345-0@lo:502: 00000100:00100000:3.0:1788463256.969936:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9841:x1875339485685888:12345-0@lo:502: Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463256.969942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463256.969967:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463256.969977:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9841:1875339485685888:0@lo:502: 00000100:00100000:3.0:1788463256.970023:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9841:1875339485686016:0@lo:502: 00000100:00100000:3.0:1788463256.970052:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.970168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686016 00000100:00100000:3.0:1788463256.970172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686016 00000100:00100000:3.0:1788463256.970194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788463256.970199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9841:x1875339485686016:12345-0@lo:502: 00000100:00100000:3.0:1788463256.970261:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:9841:x1875339485686016:12345-0@lo:502: Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463256.970267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788463256.970293:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463256.970303:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9841:1875339485686016:0@lo:502: 00000040:00080000:3.0:1788463256.970321:0:9841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788463256.970509:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788463256.970528:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463256.970538:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970549:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463256.970559:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788463256.970561:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788463256.970564:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788463256.970613:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970622:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970641:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.970654:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686144:0@lo:101: 00000100:00100000:3.0:1788463256.970680:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.970693:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463256.970705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686144 00000100:00100000:3.0:1788463256.970708:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686144 00000100:00100000:3.0:1788463256.970743:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788463256.970750:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485686144:12345-0@lo:101: 00010000:00010000:3.0:1788463256.970757:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463256.970767:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39654 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970788:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39654 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970798:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39654 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.970807:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030c00, rc 0) 00000100:00100000:3.0:1788463256.970835:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686144:12345-0@lo:101: Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463256.970973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788463256.971010:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686144:0@lo:101: 00010000:00010000:3.0:1788463256.971023:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.971042:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.971166:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686272:0@lo:501: 00000100:00100000:3.0:1788463256.971189:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.971266:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.978086:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686272 00000100:00100000:0.0:1788463256.978103:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686272 00000100:00100000:0.0:1788463256.978171:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463256.978181:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686272:12345-0@lo:501: 00000100:00100000:0.0:1788463256.978359:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686272:12345-0@lo:501: Request processed in 179us (7168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.978367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463256.978408:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686272:0@lo:501: 00000100:00100000:1.0:1788463256.978457:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686400:0@lo:503: 00000100:00100000:1.0:1788463256.978504:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463256.978545:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888e26540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.978677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686400 00000100:00100000:0.0:1788463256.978682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686400 00000100:00100000:0.0:1788463256.978725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788463256.978732:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686400:12345-0@lo:503: 00000100:00100000:0.0:1788463256.978811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686400:12345-0@lo:503: Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.978819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788463256.978866:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686400:0@lo:503: 00000100:00100000:0.0:1788463256.979240:0:9842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9842:1875339485686528:0@lo:502: 00000100:00100000:0.0:1788463256.979278:0:9842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.979345:0:9842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463256.979667:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686528 00000100:00100000:1.0:1788463256.979673:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686528 00000100:00100000:1.0:1788463256.979755:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463256.979763:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9842:x1875339485686528:12345-0@lo:502: 00000100:00100000:1.0:1788463256.980020:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9842:x1875339485686528:12345-0@lo:502: Request processed in 257us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463256.980028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788463256.980304:0:9842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9842:1875339485686528:0@lo:502: 00000020:01000000:0.0:1788463256.980332:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463256.980342:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463256.980344:0:9842:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463256.980349:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463256.980351:0:9842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788463256.980382:0:9842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9842:1875339485686656:0@lo:502: 00000100:00100000:0.0:1788463256.980782:0:9842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.980820:0:9842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.981231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686656 00000100:00100000:0.0:1788463256.981238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686656 00000100:00100000:0.0:1788463256.981274:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788463256.981281:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9842:x1875339485686656:12345-0@lo:502: 00000100:00100000:0.0:1788463256.981477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:9842:x1875339485686656:12345-0@lo:502: Request processed in 195us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.981485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788463256.981534:0:9842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9842:1875339485686656:0@lo:502: 00000020:01000000:0.0:1788463256.981560:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463256.981566:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463256.981568:0:9842:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463256.981571:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788463256.982344:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788463256.982481:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788463256.982491:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982510:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463256.982520:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463256.982523:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188d0ea000 from 39 10000000:01000000:0.0:1788463256.982525:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463256.982552:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982560:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982569:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463256.982605:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686784:0@lo:101: 00000100:00100000:0.0:1788463256.982653:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.982676:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.982692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686784 00000100:00100000:0.0:1788463256.982696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686784 00000100:00100000:0.0:1788463256.982739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463256.982749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485686784:12345-0@lo:101: 00010000:00010000:0.0:1788463256.982760:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463256.982775:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39662 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982797:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39662 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982819:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39662 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982827:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5e00, rc 0) 00000100:00100000:0.0:1788463256.982862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485686784:12345-0@lo:101: Request processed in 115us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.982868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463256.982906:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686784:0@lo:101: 00010000:00010000:0.0:1788463256.982919:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.982927:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463256.982968:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686912:0@lo:501: 00000100:00100000:0.0:1788463256.982988:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.982999:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.983010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485686912 00000100:00100000:0.0:1788463256.983013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485686912 00000100:00100000:0.0:1788463256.983031:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463256.983036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485686912:12345-0@lo:501: 00000100:00100000:0.0:1788463256.984553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485686912:12345-0@lo:501: Request processed in 1511us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.984563:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788463256.984927:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485686912:0@lo:501: 00000100:00100000:1.0:1788463256.984971:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687040:0@lo:503: 00000100:00100000:1.0:1788463256.985016:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463256.985042:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888e26300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.985158:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687040 00000100:00100000:0.0:1788463256.985165:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687040 00000100:00100000:0.0:1788463256.985207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463256.985215:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485687040:12345-0@lo:503: 00000100:00100000:0.0:1788463256.985295:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485687040:12345-0@lo:503: Request processed in 81us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.985302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463256.985757:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687040:0@lo:503: 00000100:00100000:1.0:1788463256.986295:0:9843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9843:1875339485687168:0@lo:502: 00000100:00100000:1.0:1788463256.986346:0:9843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463256.986558:0:9843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.986831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687168 00000100:00100000:0.0:1788463256.986837:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687168 00000100:00100000:0.0:1788463256.986878:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463256.986888:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:9843:x1875339485687168:12345-0@lo:502: 00000100:00100000:0.0:1788463256.986980:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:9843:x1875339485687168:12345-0@lo:502: Request processed in 93us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.986987:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788463256.987140:0:9843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9843:1875339485687168:0@lo:502: 00000100:00100000:1.0:1788463256.987184:0:9843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9843:1875339485687296:0@lo:502: 00000100:00100000:1.0:1788463256.987218:0:9843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463256.987247:0:9843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.987289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687296 00000100:00100000:0.0:1788463256.987294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687296 00000100:00100000:0.0:1788463256.987321:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788463256.987327:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:9843:x1875339485687296:12345-0@lo:502: 00000100:00100000:0.0:1788463256.987512:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:9843:x1875339485687296:12345-0@lo:502: Request processed in 184us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.987518:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463256.987609:0:9843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9843:1875339485687296:0@lo:502: 00000040:00080000:1.0:1788463256.987627:0:9843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788463256.987780:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788463256.987798:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463256.987808:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.987817:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463256.987826:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463256.987836:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188d0ea000 from 6 10000000:01000000:0.0:1788463256.987839:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463256.987864:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.987872:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.987881:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463256.987893:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687424:0@lo:101: 00000100:00100000:0.0:1788463256.987923:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.987952:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463256.987998:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687424 00000100:00100000:1.0:1788463256.988003:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687424 00000100:00100000:1.0:1788463256.988032:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788463256.988039:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485687424:12345-0@lo:101: 00010000:00010000:1.0:1788463256.988047:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463256.988518:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c207e200/0x841acb7f42a39677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39670 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463256.988545:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207e200/0x841acb7f42a39677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39670 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463256.988555:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c207e200/0x841acb7f42a39677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39670 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463256.988563:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c207e200, rc 0) 00000100:00100000:1.0:1788463256.988627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485687424:12345-0@lo:101: Request processed in 588us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463256.988644:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788463256.988727:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687424:0@lo:101: 00010000:00010000:0.0:1788463256.988743:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.988753:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463256.988802:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687552:0@lo:256: 00000100:00100000:0.0:1788463256.988833:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463256.989410:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463256.989880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687552 00000100:00100000:1.0:1788463256.989888:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687552 00000100:00100000:1.0:1788463256.989967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788463256.989976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485687552:12345-0@lo:256: 20000000:01000000:1.0:1788463256.989992:0:6517:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463256.990009:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463256.990013:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788463256.990234:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485687552:12345-0@lo:256: Request processed in 258us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463256.990243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788463256.990305:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687552:0@lo:256: 10000000:01000000:3.0:1788463256.990370:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463256.990379:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.990399:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463256.990408:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788463256.990411:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788463256.990415:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788463256.990440:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.990448:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.990457:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.990473:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687680:0@lo:101: 00000100:00100000:3.0:1788463256.990515:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.990888:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.990923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687680 00000100:00100000:0.0:1788463256.990928:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687680 00000100:00100000:0.0:1788463256.990956:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788463256.990965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485687680:12345-0@lo:101: 00010000:00010000:0.0:1788463256.990974:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463256.990991:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3967e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.991013:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3967e expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.991023:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3967e expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463256.991030:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5200, rc 0) 00000100:00100000:0.0:1788463256.991146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485687680:12345-0@lo:101: Request processed in 182us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.991152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788463256.991273:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687680:0@lo:101: 00010000:00010000:3.0:1788463256.991288:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463256.991298:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463256.991491:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687808:0@lo:501: 00000100:00100000:3.0:1788463256.991522:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.991616:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.991743:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687808 00000100:00100000:0.0:1788463256.991748:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687808 00000100:00100000:0.0:1788463256.991807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788463256.991815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485687808:12345-0@lo:501: 00000100:00100000:0.0:1788463256.991927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485687808:12345-0@lo:501: Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.991934:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788463256.991991:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687808:0@lo:501: 00000100:00100000:3.0:1788463256.992019:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687936:0@lo:503: 00000100:00100000:3.0:1788463256.992057:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.992195:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463256.992225:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485687936 00000100:00100000:1.0:1788463256.992230:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485687936 00000100:00100000:1.0:1788463256.992254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788463256.992261:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485687936:12345-0@lo:503: 00000100:00100000:1.0:1788463256.992348:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485687936:12345-0@lo:503: Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463256.992368:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788463256.993174:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485687936:0@lo:503: 00000100:00100000:3.0:1788463256.993820:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9844:1875339485688064:0@lo:502: 00000100:00100000:3.0:1788463256.993871:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463256.993906:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463256.993957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688064 00000100:00100000:0.0:1788463256.993963:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688064 00000100:00100000:0.0:1788463256.994004:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788463256.994013:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:9844:x1875339485688064:12345-0@lo:502: 00000100:00100000:0.0:1788463256.994187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:9844:x1875339485688064:12345-0@lo:502: Request processed in 174us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463256.994194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788463256.994278:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9844:1875339485688064:0@lo:502: 00000020:01000000:3.0:1788463256.994298:0:9844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463256.994306:0:9844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788463256.994313:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463256.994315:0:9844:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788463256.994320:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463256.994329:0:9844:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:3.0:1788463256.994349:0:9844:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788463256.994351:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463256.994376:0:9844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff96188f6019c0) 00000020:00000080:3.0:1788463256.994521:0:9844:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788463256.994529:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463256.994628:0:9844:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788463256.994634:0:9844:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788463256.994704:0:9844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a39693 00010000:00080000:3.0:1788463256.994744:0:9844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961787c78000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463256.994989:0:9844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788463256.995262:0:9844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788463256.995273:0:9844:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788463256.995704:0:9844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463256.995825:0:9844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463256.995950:0:9844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788463256.996037:0:9844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788463256.998548:0:9845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463256.998555:0:9845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788463257.001230:0:9844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463257.001244:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463257.001293:0:9844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788463257.001319:0:9844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3969a 00000100:00080000:0.0:1788463257.001332:0:9844:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463257.001338:0:9844:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961787c78000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463257.001382:0:9844:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c1880 x1875339485688192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463257.002279:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485688192:0@lo:8: 00000100:00100000:1.0:1788463257.002350:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463257.002781:0:9844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788463257.002848:0:9844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463257.002854:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463257.002856:0:9844:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788463257.002859:0:9844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463257.002863:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463257.002864:0:9844:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463257.002867:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463257.002869:0:9844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788463257.002897:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9844:1875339485688320:0@lo:502: 00000100:00100000:0.0:1788463257.002947:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.002974:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.003176:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688192 00000100:00100000:3.0:1788463257.003184:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688192 00000100:00100000:3.0:1788463257.003222:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463257.003230:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485688192:12345-0@lo:8: 00010000:00080000:3.0:1788463257.003253:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:3.0:1788463257.003282:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a396a1 00002000:00100000:3.0:1788463257.003293:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff961787c79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788463257.003297:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788463257.003301:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788463257.003370:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788463257.003932:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788463257.003957:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787c7e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463257.004026:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485688192:12345-0@lo:8: Request processed in 794us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.004033:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788463257.009472:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1880 x1875339485688192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.009488:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463257.009498:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788463257.009507:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463257.009514:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788463257.009517:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787c78000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463257.009542:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463257.009548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485688192:0@lo:8: 00000100:00100000:0.0:1788463257.009604:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688320 00000100:00100000:0.0:1788463257.009612:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688320 00000100:00100000:0.0:1788463257.009676:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788463257.009685:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:9844:x1875339485688320:12345-0@lo:502: 00000100:00100000:0.0:1788463257.009841:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:9844:x1875339485688320:12345-0@lo:502: Request processed in 157us (6892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.009849:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788463257.009914:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9844:1875339485688320:0@lo:502: 00000020:01000000:0.0:1788463257.009942:0:9844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463257.009949:0:9844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463257.009952:0:9844:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463257.009956:0:9844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788463257.010019:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788463257.010035:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788463257.010044:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.010054:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463257.011753:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463257.011756:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618850d0800 from 39 10000000:01000000:0.0:1788463257.011761:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463257.011799:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.011808:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.011818:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463257.011848:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485688448:0@lo:101: 00000100:00100000:0.0:1788463257.011907:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.011948:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96d80 going to sleep for 11 seconds 00000004:00080000:1.0:1788463257.012109:0:9845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788463257.012182:0:9845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 296463606726ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788463257.012189:0:9845:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788463257.012244:0:9846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485688576:0@lo:700: 00000100:00100000:1.0:1788463257.012275:0:9846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.012306:0:9846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618991e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.012652:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688576 00000100:00100000:3.0:1788463257.012660:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688576 00000100:00100000:3.0:1788463257.012712:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463257.012735:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9846:x1875339485688576:12345-0@lo:700: 00000100:00100000:3.0:1788463257.012771:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1875339485688704:0@lo:700: 00000100:00100000:3.0:1788463257.012804:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.012823:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.012837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688448 00000100:00100000:3.0:1788463257.013471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688448 00000100:00100000:3.0:1788463257.013514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788463257.013521:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485688448:12345-0@lo:101: 00010000:00010000:3.0:1788463257.013530:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463257.013545:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a396a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463257.013566:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463257.013593:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463257.013602:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030800, rc 0) 00000100:00100000:0.0:1788463257.013638:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688704 00000100:00100000:0.0:1788463257.013643:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688704 00000100:00100000:3.0:1788463257.013648:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485688448:12345-0@lo:101: Request processed in 128us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.013654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788463257.013669:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463257.013676:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1875339485688704:12345-0@lo:700: 00000100:00080000:3.0:1788463257.013683:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463257.013694:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463257.013740:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485688448:0@lo:101: 00010000:00010000:3.0:1788463257.013756:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463257.013765:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463257.013823:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485688832:0@lo:501: 00000100:00100000:3.0:1788463257.013851:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.013875:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.013916:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485688960:0@lo:400: 00000100:00100000:3.0:1788463257.013942:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.013972:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688960 00000100:00100000:3.0:1788463257.013976:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688960 00000100:00100000:3.0:1788463257.014011:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463257.014019:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485688960:12345-0@lo:400: 00000100:00100000:3.0:1788463257.014053:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485688960:12345-0@lo:400: Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.014059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788463257.014085:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dd500 x1875339485688960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.014095:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485688960:0@lo:400: 00000100:00100000:3.0:1788463257.014129:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485689088:0@lo:400: 00000100:00100000:3.0:1788463257.014155:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.014187:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689088 00000100:00100000:1.0:1788463257.014192:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689088 00000100:00100000:3.0:1788463257.014204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485689216:0@lo:400: 00000100:00100000:1.0:1788463257.014218:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463257.014224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485689088:12345-0@lo:400: 00000100:00100000:3.0:1788463257.014236:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.014254:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485689088:12345-0@lo:400: Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463257.014260:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788463257.014267:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485689088:0@lo:400: 00000100:00100000:3.0:1788463257.014303:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463257.014311:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485689344:0@lo:400: 00000100:00100000:0.0:1788463257.014317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485688832 00000100:00100000:0.0:1788463257.014320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485688832 00000100:00100000:3.0:1788463257.014332:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.014342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788463257.014347:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485688832:12345-0@lo:501: 00000100:00100000:3.0:1788463257.014980:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689344 00000100:00100000:3.0:1788463257.014986:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689344 00000100:00100000:3.0:1788463257.015012:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463257.015019:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485689344:12345-0@lo:400: 00000100:00100000:3.0:1788463257.015056:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485689344:12345-0@lo:400: Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.015062:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463257.015088:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485689344:0@lo:400: 00000100:00100000:3.0:1788463257.015121:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485689472:0@lo:400: 00000100:00100000:3.0:1788463257.015146:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.015169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689216 00000100:00100000:3.0:1788463257.015173:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689216 00000100:00100000:3.0:1788463257.015191:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689472 00000100:00100000:3.0:1788463257.015194:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689472 00000100:00100000:3.0:1788463257.015218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463257.015224:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485689216:12345-0@lo:400: 00000100:00100000:3.0:1788463257.015255:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485689216:12345-0@lo:400: Request processed in 31us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.015261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463257.015273:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463257.015279:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485689472:12345-0@lo:400: 00000100:00100000:3.0:1788463257.015318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485689472:12345-0@lo:400: Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.015324:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788463257.015338:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788463257.015440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dfb80 x1875339485689216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.015451:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485689216:0@lo:400: 00010000:00080000:3.0:1788463257.015475:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dd500 x1875339485689472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.015485:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485689472:0@lo:400: 00000100:00100000:3.0:1788463257.015515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485689600:0@lo:400: 00000100:00100000:3.0:1788463257.015539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.015563:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689600 00000100:00100000:3.0:1788463257.015567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689600 00000100:00100000:3.0:1788463257.015607:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463257.015614:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485689600:12345-0@lo:400: 00000100:00100000:3.0:1788463257.015644:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485689600:12345-0@lo:400: Request processed in 32us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.015651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788463257.015662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788463257.015677:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dd500 x1875339485689600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.015686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485689600:0@lo:400: 00000100:00100000:3.0:1788463257.015712:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485689728:0@lo:400: 00000100:00100000:3.0:1788463257.015760:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.015788:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689728 00000100:00100000:3.0:1788463257.015792:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689728 00000100:00100000:3.0:1788463257.015818:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463257.015823:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485689728:12345-0@lo:400: 00000100:00100000:3.0:1788463257.015874:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485689728:12345-0@lo:400: Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.015880:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788463257.015893:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463257.015908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dd500 x1875339485689728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.015918:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485689728:0@lo:400: 00000100:00100000:3.0:1788463257.015947:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485689856:0@lo:400: 00000100:00100000:3.0:1788463257.015970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.015996:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689856 00000100:00100000:3.0:1788463257.015999:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689856 00000100:00100000:3.0:1788463257.016019:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463257.016025:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485689856:12345-0@lo:400: 00000100:00100000:3.0:1788463257.016054:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485689856:12345-0@lo:400: Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.016061:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788463257.016072:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463257.016088:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32a00 x1875339485689856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.016096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485689856:0@lo:400: 00000100:00100000:3.0:1788463257.016122:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485689984:0@lo:400: 00000100:00100000:3.0:1788463257.016152:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.016174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485689984 00000100:00100000:3.0:1788463257.016178:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485689984 00000100:00100000:3.0:1788463257.016200:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463257.016206:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485689984:12345-0@lo:400: 00000100:00100000:3.0:1788463257.016235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485689984:12345-0@lo:400: Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.016241:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788463257.016252:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788463257.016265:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32a00 x1875339485689984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.016274:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485689984:0@lo:400: 00000100:00100000:0.0:1788463257.016888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485688832:12345-0@lo:501: Request processed in 2536us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.016899:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788463257.017179:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485688832:0@lo:501: 00000100:00100000:1.0:1788463257.017232:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690112:0@lo:503: 00000100:00100000:1.0:1788463257.017281:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.017308:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.017422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690112 00000100:00100000:0.0:1788463257.017428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690112 00000100:00100000:0.0:1788463257.017459:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788463257.017467:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485690112:12345-0@lo:503: 00000100:00100000:0.0:1788463257.017560:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485690112:12345-0@lo:503: Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.017567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788463257.017629:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690112:0@lo:503: 00000004:00080000:0.0:1788463257.020680:0:7455:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788463257.021304:0:9847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9847:1875339485690240:0@lo:502: 00000100:00100000:1.0:1788463257.021468:0:9847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.021548:0:9847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db300 going to sleep for 11 seconds 40000000:02000000:3.0:1788463257.021806:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788463257.021927:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690240 00000100:00100000:0.0:1788463257.021936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690240 00000100:00100000:0.0:1788463257.022027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463257.022037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:9847:x1875339485690240:12345-0@lo:502: 00000100:00100000:0.0:1788463257.022169:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:9847:x1875339485690240:12345-0@lo:502: Request processed in 133us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.022177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788463257.022320:0:9847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9847:1875339485690240:0@lo:502: 00000100:00100000:1.0:1788463257.022369:0:9847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9847:1875339485690368:0@lo:502: 00000100:00100000:1.0:1788463257.022478:0:9847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.022501:0:9847:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.022548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690368 00000100:00100000:0.0:1788463257.022552:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690368 00000100:00100000:0.0:1788463257.022697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788463257.022705:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:9847:x1875339485690368:12345-0@lo:502: 00000100:00100000:0.0:1788463257.022782:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:9847:x1875339485690368:12345-0@lo:502: Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.022789:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788463257.023033:0:9847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9847:1875339485690368:0@lo:502: 00000040:00080000:1.0:1788463257.023054:0:9847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788463257.023299:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788463257.023321:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463257.023330:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.023340:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463257.023349:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463257.023352:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9618850d0800 from 6 10000000:01000000:0.0:1788463257.023354:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463257.023381:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.023463:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.023473:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463257.023498:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690496:0@lo:101: 00000100:00100000:0.0:1788463257.023533:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.023613:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463257.023663:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690496 00000100:00100000:1.0:1788463257.023668:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690496 00000100:00100000:1.0:1788463257.023809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788463257.023818:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485690496:12345-0@lo:101: 00010000:00010000:1.0:1788463257.023834:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463257.023861:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c207e800/0x841acb7f42a396bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a396b6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.023882:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207e800/0x841acb7f42a396bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a396b6 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.023894:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c207e800/0x841acb7f42a396bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396b6 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.023902:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c207e800, rc 0) 00000100:00100000:1.0:1788463257.023935:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485690496:12345-0@lo:101: Request processed in 119us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463257.023942:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788463257.024304:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690496:0@lo:101: 00010000:00010000:0.0:1788463257.024317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463257.024326:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463257.024370:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690624:0@lo:256: 00000100:00100000:0.0:1788463257.024414:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.024434:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.024446:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690624 00000100:00100000:0.0:1788463257.024450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690624 00000100:00100000:0.0:1788463257.024475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788463257.024481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485690624:12345-0@lo:256: 20000000:01000000:0.0:1788463257.024495:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463257.024510:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463257.024513:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788463257.024627:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485690624:12345-0@lo:256: Request processed in 144us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.024634:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788463257.024644:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690624:0@lo:256: 10000000:01000000:2.0:1788463257.024687:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463257.024693:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.024700:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463257.024707:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788463257.024709:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788463257.024711:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788463257.024740:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.024748:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.024757:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463257.024769:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690752:0@lo:101: 00000100:00100000:2.0:1788463257.024801:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463257.024831:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463257.024837:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690752 00000100:00100000:1.0:1788463257.024968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690752 00000100:00100000:1.0:1788463257.025037:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788463257.025045:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485690752:12345-0@lo:101: 00010000:00010000:1.0:1788463257.025053:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463257.025152:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a396c4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.025171:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.025180:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.025188:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c207f800, rc 0) 00000100:00100000:1.0:1788463257.025233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485690752:12345-0@lo:101: Request processed in 188us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463257.025238:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788463257.025256:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690752:0@lo:101: 00010000:00010000:2.0:1788463257.025268:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.025277:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463257.025325:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690880:0@lo:501: 00000100:00100000:2.0:1788463257.025429:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463257.025487:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.025517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485690880 00000100:00100000:0.0:1788463257.025521:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485690880 00000100:00100000:0.0:1788463257.025554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788463257.025562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485690880:12345-0@lo:501: 00000100:00100000:0.0:1788463257.028270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485690880:12345-0@lo:501: Request processed in 2702us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.028282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463257.028499:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485690880:0@lo:501: 00000100:00100000:1.0:1788463257.028548:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691008:0@lo:503: 00000100:00100000:1.0:1788463257.028610:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.028641:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.028654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691008 00000100:00100000:0.0:1788463257.028660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691008 00000100:00100000:0.0:1788463257.028702:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788463257.028710:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485691008:12345-0@lo:503: 00000100:00100000:0.0:1788463257.029247:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485691008:12345-0@lo:503: Request processed in 537us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.029254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788463257.029312:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691008:0@lo:503: 00000100:00100000:2.0:1788463257.029548:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8448:x1875339485688704:12345-0@lo:700: Request processed in 15871us (16742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463257.029558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788463257.029571:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9df480 x1875339485688704/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.029605:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8448:1875339485688704:0@lo:700: 40000000:02000000:0.0:1788463257.029612:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788463257.036230:0:9848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9848:1875339485691136:0@lo:502: 00000100:00100000:3.0:1788463257.036307:0:9848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.036435:0:9848:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463257.036494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691136 00000100:00100000:1.0:1788463257.036502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691136 00000100:00100000:1.0:1788463257.036554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788463257.036563:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:9848:x1875339485691136:12345-0@lo:502: 00000100:00100000:1.0:1788463257.036701:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:9848:x1875339485691136:12345-0@lo:502: Request processed in 138us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463257.036710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788463257.037268:0:9848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9848:1875339485691136:0@lo:502: 00000020:01000000:3.0:1788463257.037297:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463257.037304:0:9848:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788463257.037310:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463257.037313:0:9848:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788463257.037318:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463257.037322:0:9848:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:3.0:1788463257.037344:0:9848:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788463257.037347:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463257.037645:0:9848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff961787c9b380) 00000020:00000080:3.0:1788463257.037670:0:9848:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788463257.037682:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463257.038122:0:9848:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788463257.038128:0:9848:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788463257.038135:0:9848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a396d9 00010000:00080000:3.0:1788463257.038164:0:9848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961787d27800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463257.039761:0:9848:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788463257.039891:0:9848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788463257.039905:0:9848:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000001:00100000:1.0:1788463257.040116:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788463257.040216:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485688576:12345-0@lo:700: Request processed in 27480us (27936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463257.040227:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788463257.040269:0:9846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727ca80 x1875339485688576/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463257.040284:0:9846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485688576:0@lo:700: 00000040:00080000:3.0:1788463257.040507:0:9848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463257.040789:0:9848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463257.040901:0:9848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788463257.040983:0:9848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788463257.045288:0:9853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463257.045296:0:9853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788463257.046568:0:9848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788463257.046601:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788463257.046638:0:9848:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788463257.046663:0:9848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a396e0 00000100:00080000:2.0:1788463257.046673:0:9848:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463257.046679:0:9848:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d27800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463257.046723:0:9848:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787b5dc00 x1875339485691264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463257.046741:0:9848:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788463257.046822:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463257.046826:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463257.046828:0:9848:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788463257.046831:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463257.046839:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463257.046840:0:9848:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463257.046844:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463257.046845:0:9848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788463257.046873:0:9848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9848:1875339485691392:0@lo:502: 00000100:00100000:2.0:1788463257.046991:0:9848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463257.047104:0:9848:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788463257.047152:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691392 00000100:00100000:0.0:1788463257.047159:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691392 00000100:00100000:3.0:1788463257.047245:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485691264:0@lo:8: 00000100:00100000:3.0:1788463257.047280:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.047308:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691264 00000100:00100000:3.0:1788463257.047311:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691264 00000100:00100000:3.0:1788463257.047335:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463257.047342:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485691264:12345-0@lo:8: 00000100:00100000:0.0:1788463257.047448:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788463257.047457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:9848:x1875339485691392:12345-0@lo:502: 00000100:00100000:0.0:1788463257.047562:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:9848:x1875339485691392:12345-0@lo:502: Request processed in 106us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.047569:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:3.0:1788463257.047662:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:3.0:1788463257.047688:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a396e7 00002000:00100000:3.0:1788463257.047702:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff961787d27000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788463257.047706:0:8441:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788463257.047709:0:8441:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788463257.047797:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788463257.047820:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787d23800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463257.047865:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485691264:12345-0@lo:8: Request processed in 522us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.047871:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788463257.047951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5dc00 x1875339485691264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463257.047964:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463257.047971:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788463257.047978:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788463257.047983:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788463257.047985:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d27800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788463257.048103:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788463257.048109:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485691264:0@lo:8: 00000004:00080000:3.0:1788463257.048178:0:9853:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788463257.048227:0:9853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296499651761ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788463257.048233:0:9853:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788463257.048904:0:9848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:9848:1875339485691392:0@lo:502: 00000020:01000000:0.0:1788463257.048936:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463257.048943:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463257.048945:0:9848:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463257.048950:0:9848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788463257.049326:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788463257.049348:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788463257.049428:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.049439:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463257.049450:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788463257.049453:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff961884ff19c0 from 1 10000000:01000000:1.0:1788463257.049456:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463257.049496:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.049503:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463257.049512:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463257.049529:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691520:0@lo:101: 00000100:00100000:1.0:1788463257.050520:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.050566:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463257.050890:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691520 00000100:00100000:2.0:1788463257.050897:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691520 00000100:00100000:2.0:1788463257.051416:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788463257.051428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485691520:12345-0@lo:101: 00010000:00010000:2.0:1788463257.051443:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463257.051459:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a396ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.051484:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a396ee expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.051501:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396ee expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.051510:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:2.0:1788463257.051566:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485691520:12345-0@lo:101: Request processed in 141us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463257.051588:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788463257.051935:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691520:0@lo:101: 00010000:00010000:2.0:1788463257.051952:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.051962:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463257.052034:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691648:0@lo:501: 00000100:00100000:2.0:1788463257.052065:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463257.052090:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463257.052103:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691648 00000100:00100000:2.0:1788463257.052107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691648 00000100:00100000:2.0:1788463257.052133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463257.052140:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485691648:12345-0@lo:501: 00000100:00100000:2.0:1788463257.052204:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485691648:12345-0@lo:501: Request processed in 64us (138us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463257.052210:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463257.052237:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485691648:0@lo:501: 10000000:01000000:2.0:1788463257.052263:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788463257.052270:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463257.052277:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463257.053090:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788463257.053769:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1788463257.053791:0:9846:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788463257.053818:0:9846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485691904:0@lo:7: 00000100:00100000:1.0:1788463257.053869:0:9846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463257.053895:0:9846:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.053907:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691904 00000100:00100000:3.0:1788463257.053913:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691904 00000100:00100000:0.0:1788463257.053933:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485691776:0@lo:13: 00000100:00100000:3.0:1788463257.053958:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463257.053961:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.053967:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485691904:12345-0@lo:7: 00000100:00100000:0.0:1788463257.055328:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485691776 00000100:00100000:0.0:1788463257.055337:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485691776 00000100:00100000:0.0:1788463257.055446:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463257.055457:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875339485691776:12345-0@lo:13: 00002000:00000024:0.0:1788463257.055480:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923890176 avail 3692367872 00000100:00100000:0.0:1788463257.055545:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875339485691776:12345-0@lo:13: Request processed in 90us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.055552:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788463257.055610:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b46680 x1875339485691776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.055630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485691776:0@lo:13: 00002000:00080000:3.0:1788463257.057675:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788463257.057683:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788463257.057775:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485691904:12345-0@lo:7: Request processed in 3806us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.057785:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:3.0:1788463257.058430:0:9854:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788463257.058458:0:9854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692160:0@lo:7: 00000100:00100000:3.0:1788463257.058500:0:9854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.058523:0:9854:0:(client.c:2716:ptlrpc_set_wait()) set ffff96178712acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.058541:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485692032:0@lo:13: 00000100:00100000:3.0:1788463257.058563:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.058614:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692160 00000100:00100000:3.0:1788463257.058621:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692160 00000100:00100000:3.0:1788463257.058666:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463257.058674:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9854:x1875339485692160:12345-0@lo:7: 00010000:00080000:2.0:1788463257.060600:0:9846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b45f80 x1875339485691904/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463257.060618:0:9846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485691904:0@lo:7: 00000004:00080000:2.0:1788463257.060631:0:9846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788463257.060667:0:9846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485692288:0@lo:5: 00000100:00100000:2.0:1788463257.060727:0:9846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463257.060762:0:9846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463257.060782:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788463257.060789:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788463257.062767:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692288 00000100:00100000:2.0:1788463257.062777:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692288 00000100:00100000:2.0:1788463257.062889:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463257.062899:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485692288:12345-0@lo:5: 00002000:00080000:2.0:1788463257.062929:0:9857:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00002000:00080000:3.0:1788463257.062967:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788463257.062973:0:8439:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788463257.062999:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485692288:12345-0@lo:5: Request processed in 102us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463257.063007:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788463257.063051:0:9846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5d880 x1875339485692288/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463257.063065:0:9846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485692288:0@lo:5: 00000004:00080000:2.0:1788463257.063077:0:9846:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788463257.063084:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9854:x1875339485692160:12345-0@lo:7: Request processed in 4410us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.063091:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788463257.063114:0:9846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485692416:0@lo:5: 00010000:00080000:3.0:1788463257.063118:0:9854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32a00 x1875339485692160/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.063133:0:9854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692160:0@lo:7: 00000100:00100000:2.0:1788463257.063141:0:9846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788463257.063142:0:9854:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788463257.063159:0:9846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.063160:0:9854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692544:0@lo:5: 00000100:00100000:2.0:1788463257.063170:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692416 00000100:00100000:2.0:1788463257.063173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692416 00000100:00100000:3.0:1788463257.063180:0:9854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.063188:0:9854:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f5786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463257.063190:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692544 00000100:00100000:2.0:1788463257.063192:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692544 00000100:00100000:3.0:1788463257.063202:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692032 00000100:00100000:2.0:1788463257.063203:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463257.063205:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692032 00000100:00100000:2.0:1788463257.063208:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9846:x1875339485692416:12345-0@lo:5: 00002000:00080000:2.0:1788463257.063229:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788463257.063230:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463257.063236:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485692032:12345-0@lo:13: 00002000:00000024:3.0:1788463257.063246:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923668992 avail 3692146688 00000100:00100000:3.0:1788463257.063279:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485692032:12345-0@lo:13: Request processed in 43us (4715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.063285:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788463257.063300:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463257.063312:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463257.063319:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9854:x1875339485692544:12345-0@lo:5: 00002000:00080000:3.0:1788463257.063343:0:8441:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788463257.063346:0:8441:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1788463257.063675:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9df480 x1875339485692032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.063690:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485692032:0@lo:13: 00000100:00100000:3.0:1788463257.066119:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9846:x1875339485692416:12345-0@lo:5: Request processed in 2904us (2970us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788463257.066131:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788463257.066479:0:9846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5d880 x1875339485692416/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.066499:0:9846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9846:1875339485692416:0@lo:5: 00000004:00080000:0.0:1788463257.066514:0:9846:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788463257.066557:0:9846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9846:1875339485692672:0@lo:900: 00000100:00100000:0.0:1788463257.066620:0:9846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.066647:0:9846:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.066828:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692672 00000100:00100000:3.0:1788463257.066841:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692672 00000100:00100000:3.0:1788463257.067469:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463257.067482:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9846:x1875339485692672:12345-0@lo:900: 00000100:00100000:3.0:1788463257.067553:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9846:x1875339485692672:12345-0@lo:900: Request processed in 75us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.067561:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788463257.067617:0:9846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1880 x1875339485692672/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463257.067629:0:9846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9846:1875339485692672:0@lo:900: 00000001:00080000:1.0:1788463257.069779:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1788463257.069793:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788463257.069803:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788463257.070154:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9854:x1875339485692544:12345-0@lo:5: Request processed in 6830us (6967us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788463257.070164:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788463257.070261:0:9854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d112d80 x1875339485692544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.070273:0:9854:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788463257.070279:0:9854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692544:0@lo:5: 00000004:00080000:0.0:1788463257.070302:0:9854:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788463257.070346:0:9854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692800:0@lo:700: 00000100:00100000:0.0:1788463257.070380:0:9854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.070483:0:9854:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.070527:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692800 00000100:00100000:3.0:1788463257.070533:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692800 00000100:00100000:3.0:1788463257.070866:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463257.071027:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9854:x1875339485692800:12345-0@lo:700: 00000100:00100000:3.0:1788463257.081404:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9854:x1875339485692800:12345-0@lo:700: Request processed in 10522us (11015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.081420:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463257.082296:0:9854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1880 x1875339485692800/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463257.082314:0:9854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692800:0@lo:700: 00000004:02000040:3.0:1788463257.084235:0:9854:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788463257.095518:0:9854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692928:0@lo:5: 00000100:00100000:3.0:1788463257.095909:0:9854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.095955:0:9854:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463257.095977:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485692928 00000100:00100000:3.0:1788463257.095984:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485692928 00000100:00100000:3.0:1788463257.096151:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463257.096162:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9854:x1875339485692928:12345-0@lo:5: 00002000:00080000:3.0:1788463257.103746:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788463257.103768:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788463257.109681:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9854:x1875339485692928:12345-0@lo:5: Request processed in 13510us (13761us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788463257.109696:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788463257.110227:0:9854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9df480 x1875339485692928/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463273 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463257.110249:0:9854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9854:1875339485692928:0@lo:5: 00000004:00080000:0.0:1788463257.110269:0:9854:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788463257.222501:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463257.350095:0:9890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788463257.482804:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485693056:0@lo:41: 00000100:00100000:0.0:1788463257.482896:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463257.482979:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693056 00000100:00100000:0.0:1788463257.482986:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693056 00000100:00100000:0.0:1788463257.483034:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463257.483043:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485693056:12345-0@lo:41: 00000004:00000024:0.0:1788463257.483090:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788463257.483137:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485693056:12345-0@lo:41: Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463257.483144:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463257.483192:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485693056:0@lo:41: 00000100:00100000:0.0:1788463257.993393:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463257.993420:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485693184:0@lo:41: 00000100:00100000:0.0:1788463257.993492:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463257.993711:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693184 00000100:00100000:3.0:1788463257.993721:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693184 00000100:00100000:3.0:1788463257.993778:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463257.993788:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485693184:12345-0@lo:41: 00000004:00000024:3.0:1788463257.993823:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463257.993872:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485693184:12345-0@lo:41: Request processed in 86us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463257.993880:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463257.993933:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485693184:0@lo:41: 00010000:00010000:1.0:1788463258.244651:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463258.310226:0:9942:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463258.310459:0:9942:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1788463259.145383:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1788463259.267773:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463260.313284:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463260.548567:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463260.548615:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485693312:0@lo:13: 00000100:00100000:1.0:1788463260.548697:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463260.548796:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693312 00000100:00100000:2.0:1788463260.548811:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693312 00000100:00100000:2.0:1788463260.548875:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463260.548888:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485693312:12345-0@lo:13: 00002000:00000024:2.0:1788463260.548916:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463260.548960:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485693312:12345-0@lo:13: Request processed in 77us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463260.548966:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788463260.549027:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463260.549058:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5e300 x1875339485693312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463260.549076:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485693312:0@lo:13: 00000100:00100000:3.0:1788463261.060293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485693440:0@lo:13: 00000100:00100000:3.0:1788463261.060398:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.060567:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693440 00000100:00100000:2.0:1788463261.060604:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693440 00000100:00100000:2.0:1788463261.060701:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463261.060718:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485693440:12345-0@lo:13: 00002000:00000024:2.0:1788463261.060749:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463261.060809:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485693440:12345-0@lo:13: Request processed in 98us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.060817:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788463261.061008:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463261.061049:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5df80 x1875339485693440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463261.061074:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485693440:0@lo:13: 00010000:00010000:0.0:1788463261.319816:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463261.372875:0:10044:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463261.373110:0:10044:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788463262.083877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485693824:0@lo:400: 00000100:00100000:1.0:1788463262.084016:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463262.084066:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485694336:0@lo:400: 00000100:00100000:1.0:1788463262.084108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463262.084126:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485694848:0@lo:400: 00000100:00100000:1.0:1788463262.084141:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463262.084229:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485693696:0@lo:400: 00000100:00100000:0.0:1788463262.084590:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485693568:0@lo:400: 00000100:00100000:0.0:1788463262.084650:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.084682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485694080:0@lo:400: 00000100:00100000:0.0:1788463262.084715:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.084736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485694592:0@lo:400: 00000100:00100000:0.0:1788463262.084760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.084795:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485695104:0@lo:400: 00000100:00100000:0.0:1788463262.084816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.084868:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693824 00000100:00100000:0.0:1788463262.084876:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693824 00000100:00100000:0.0:1788463262.084917:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694080 00000100:00100000:0.0:1788463262.084920:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694080 00000100:00100000:0.0:1788463262.084934:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463262.084947:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485693824:12345-0@lo:400: 00000100:00100000:0.0:1788463262.085000:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485693824:12345-0@lo:400: Request processed in 58us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.085008:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463262.085025:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463262.085031:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485694080:12345-0@lo:400: 00000100:00100000:0.0:1788463262.085061:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485694080:12345-0@lo:400: Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.085067:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463262.085084:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694592 00000100:00100000:0.0:1788463262.085087:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694592 00000100:00100000:0.0:1788463262.085385:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695104 00000100:00100000:0.0:1788463262.085389:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695104 00000100:00100000:0.0:1788463262.085414:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463262.085421:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485694592:12345-0@lo:400: 00000100:00100000:3.0:1788463262.085691:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463262.085703:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485695104:12345-0@lo:400: 00000100:00100000:2.0:1788463262.085733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693568 00000100:00100000:2.0:1788463262.085738:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693568 00000100:00100000:2.0:1788463262.085772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788463262.085791:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485693568:12345-0@lo:400: 00000100:00100000:0.0:1788463262.092343:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485694592:12345-0@lo:400: Request processed in 6910us (7570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.092359:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788463262.092412:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463262.092452:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485694080:0@lo:400: 00010000:00080000:0.0:1788463262.092466:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700ed80 x1875339485694592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463262.092477:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485694592:0@lo:400: 00000100:00100000:0.0:1788463262.092496:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463262.092512:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485695232:0@lo:13: 00000100:00100000:0.0:1788463262.092554:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.092633:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695232 00000100:00100000:0.0:1788463262.092641:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695232 00000100:00100000:0.0:1788463262.092710:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463262.092720:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485695232:12345-0@lo:13: 00002000:00000024:0.0:1788463262.092754:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463262.093315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485693824:0@lo:400: 00000100:00100000:1.0:1788463262.093332:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788463262.093345:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485693952:0@lo:400: 00000100:00100000:1.0:1788463262.093385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.093396:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485695232:12345-0@lo:13: Request processed in 676us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.093405:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463262.093417:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485694464:0@lo:400: 00000100:00080000:0.0:1788463262.093438:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463262.093446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788463262.093468:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5d180 x1875339485695232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.093472:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485694976:0@lo:400: 00000100:00100000:0.0:1788463262.093485:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463262.093500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.093511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485695232:0@lo:13: 00000100:00100000:1.0:1788463262.093562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694336 00000100:00100000:1.0:1788463262.093567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694336 00000100:00100000:0.0:1788463262.093602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694848 00000100:00100000:0.0:1788463262.093633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694848 00000100:00100000:1.0:1788463262.093660:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693952 00000100:00100000:1.0:1788463262.093665:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693952 00000100:00100000:0.0:1788463262.093671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463262.093682:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485694336:12345-0@lo:400: 00000100:00100000:1.0:1788463262.093687:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788463262.093697:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788463262.093730:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485694336:12345-0@lo:400: Request processed in 51us (9620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.093737:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463262.093750:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463262.093756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485694848:12345-0@lo:400: 00000100:00100000:1.0:1788463262.093942:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694464 00000100:00100000:1.0:1788463262.093947:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694464 00000100:00100000:1.0:1788463262.093976:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694976 00000100:00100000:1.0:1788463262.093979:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694976 00000100:00100000:1.0:1788463262.094002:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463262.094009:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485694464:12345-0@lo:400: 00000100:00100000:1.0:1788463262.094048:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485694464:12345-0@lo:400: Request processed in 40us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.094055:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463262.094072:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463262.094095:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485694976:12345-0@lo:400: 00000100:00100000:1.0:1788463262.094134:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485694976:12345-0@lo:400: Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.094141:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788463262.094471:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463262.094476:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463262.094505:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700f480 x1875339485694464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.094530:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485694464:0@lo:400: 00010000:00080000:1.0:1788463262.094542:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700c000 x1875339485694976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.094550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485694976:0@lo:400: 00010000:00080000:1.0:1788463262.094562:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700ea00 x1875339485694336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.094569:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485694336:0@lo:400: 00000100:00100000:1.0:1788463262.094650:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463262.094659:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485693952:12345-0@lo:400: 00000100:00100000:1.0:1788463262.094703:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485693952:12345-0@lo:400: Request processed in 46us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.094709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788463262.095160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485694848:12345-0@lo:400: Request processed in 1401us (11014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.095168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463262.095202:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.095239:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485694208:0@lo:400: 00000100:00100000:0.0:1788463262.095272:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.095290:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485694720:0@lo:400: 00000100:00100000:0.0:1788463262.095311:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.095338:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485693696 00000100:00100000:0.0:1788463262.095343:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485693696 00000100:00100000:0.0:1788463262.095368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694208 00000100:00100000:0.0:1788463262.095370:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694208 00000100:00100000:0.0:1788463262.095389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485694720 00000100:00100000:0.0:1788463262.095392:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485694720 00000100:00100000:0.0:1788463262.095406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463262.095412:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485693696:12345-0@lo:400: 00000100:00100000:0.0:1788463262.095451:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485693696:12345-0@lo:400: Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.095457:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463262.095469:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463262.095486:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485694208:12345-0@lo:400: 00000100:00100000:0.0:1788463262.095515:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485694208:12345-0@lo:400: Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.095522:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463262.095534:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463262.095540:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485694720:12345-0@lo:400: 00000100:00100000:0.0:1788463262.095566:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485694720:12345-0@lo:400: Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.095572:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788463262.095602:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788463262.095637:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1880 x1875339485693696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463262.095649:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485693696:0@lo:400: 00010000:00080000:0.0:1788463262.095661:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700c380 x1875339485694208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463262.095670:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485694208:0@lo:400: 00010000:00080000:0.0:1788463262.095678:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700f100 x1875339485694720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463262.095686:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485694720:0@lo:400: 00010000:00080000:1.0:1788463262.096248:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700df80 x1875339485693952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.096264:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485693952:0@lo:400: 00010000:00080000:1.0:1788463262.096284:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700d500 x1875339485694848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.097072:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485694848:0@lo:400: 00000100:00100000:1.0:1788463262.097465:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463262.097477:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485695360:0@lo:13: 00000100:00100000:1.0:1788463262.097543:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463262.097602:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695360 00000100:00100000:1.0:1788463262.097610:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695360 00000100:00100000:1.0:1788463262.097664:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463262.097673:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485695360:12345-0@lo:13: 00002000:00000024:1.0:1788463262.097696:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463262.097738:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485695360:12345-0@lo:13: Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.097745:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788463262.097781:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700d500 x1875339485695360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463262.097790:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788463262.097807:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485695360:0@lo:13: 00000100:00100000:3.0:1788463262.098778:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485695104:12345-0@lo:400: Request processed in 13072us (13954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463262.098801:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788463262.100043:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700f800 x1875339485695104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463262.100059:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485695104:0@lo:400: 00000100:00100000:2.0:1788463262.100918:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485693568:12345-0@lo:400: Request processed in 15123us (16262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463262.100931:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788463262.101167:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485693568:0@lo:400: 00010000:00010000:2.0:1788463262.340687:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463262.443124:0:10093:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463262.443135:0:10093:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1788463262.595797:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463262.595833:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485695488:0@lo:41: 00000100:00100000:0.0:1788463262.595915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463262.595987:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695488 00000100:00100000:0.0:1788463262.595994:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695488 00000100:00100000:0.0:1788463262.596043:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463262.596054:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485695488:12345-0@lo:41: 00000004:00000024:0.0:1788463262.596093:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788463262.596144:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485695488:12345-0@lo:41: Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.596151:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463262.596200:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485695488:0@lo:41: 00000100:00100000:3.0:1788463263.043955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463263.052543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466768512 00000100:00100000:2.0:1788463263.052565:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466768512 00000100:00100000:2.0:1788463263.052668:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 183 00000100:00100000:2.0:1788463263.052677:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2399:x1875339466768512:12345-192.168.204.53@tcp:250: 00010000:00080000:2.0:1788463263.052722:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from afa1ff74-abed-45cf-941d-a3a930cb8d12@192.168.204.53@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1788463263.052757:0:6516:0:(genops.c:1385:class_connect()) connect: client afa1ff74-abed-45cf-941d-a3a930cb8d12, cookie 0x841acb7f42a396fc 00000100:00080000:2.0:1788463263.052923:0:6516:0:(import.c:65:import_set_state_nolock()) ffff961787c7f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463263.053004:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+5:2399:x1875339466768512:12345-192.168.204.53@tcp:250: Request processed in 326us (9059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.053012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 183 00000100:00100000:0.0:1788463263.065624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463263.066244:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466768640 00000100:00100000:2.0:1788463263.066258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466768640 00000100:00100000:2.0:1788463263.066327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 184 00000100:00100000:2.0:1788463263.066338:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+5:6160:x1875339466768640:12345-192.168.204.53@tcp:101: 00010000:00010000:2.0:1788463263.066355:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463263.066373:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476577 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.066403:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.066414:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.066423:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20600, rc 0) 00000100:00100000:2.0:1788463263.066491:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+6:6160:x1875339466768640:12345-192.168.204.53@tcp:101: Request processed in 154us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.066498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 184 00000100:00100000:3.0:1788463263.079255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.079418:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466768768 00000100:00100000:1.0:1788463263.079432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466768768 00000100:00100000:1.0:1788463263.079514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 185 00000100:00100000:1.0:1788463263.079526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+6:6160:x1875339466768768:12345-192.168.204.53@tcp:501: 00000100:00100000:0.0:1788463263.080019:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+6:6160:x1875339466768768:12345-192.168.204.53@tcp:501: Request processed in 493us (778us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463263.080030:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 185 00000100:00100000:3.0:1788463263.089085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.089310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466768896 00000100:00100000:1.0:1788463263.089324:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466768896 00000100:00100000:1.0:1788463263.089554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:1.0:1788463263.089629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+6:6160:x1875339466768896:12345-192.168.204.53@tcp:101: 00010000:00010000:1.0:1788463263.089653:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463263.089695:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47657e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.089732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.089746:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.089757:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c200, rc 0) 00000100:00100000:1.0:1788463263.089828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+7:6160:x1875339466768896:12345-192.168.204.53@tcp:101: Request processed in 263us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463263.089835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:2.0:1788463263.094933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463263.102440:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769024 00000100:00100000:0.0:1788463263.102464:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769024 00000100:00100000:0.0:1788463263.102548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:0.0:1788463263.102562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+7:6160:x1875339466769024:12345-192.168.204.53@tcp:501: 00000100:00100000:0.0:1788463263.102837:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6160:x1875339466769024:12345-192.168.204.53@tcp:501: Request processed in 277us (7919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463263.102847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:2.0:1788463263.106758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463263.106854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769152 00000100:00100000:0.0:1788463263.106870:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769152 00000100:00100000:0.0:1788463263.107004:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:0.0:1788463263.107018:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6160:x1875339466769152:12345-192.168.204.53@tcp:503: 00000100:00100000:0.0:1788463263.107992:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6160:x1875339466769152:12345-192.168.204.53@tcp:503: Request processed in 970us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463263.108006:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:3.0:1788463263.111994:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463263.112031:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769280 00000100:00100000:3.0:1788463263.112042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769280 00000100:00100000:3.0:1788463263.112186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 189 00000100:00100000:3.0:1788463263.112200:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6179:x1875339466769280:12345-192.168.204.53@tcp:502: 00000100:00100000:3.0:1788463263.112403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6179:x1875339466769280:12345-192.168.204.53@tcp:502: Request processed in 205us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463263.112414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 189 00000100:00100000:0.0:1788463263.123283:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485695616:0@lo:41: 00000100:00100000:0.0:1788463263.123401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463263.126272:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695616 00000100:00100000:2.0:1788463263.126316:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695616 00000100:00100000:2.0:1788463263.126419:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788463263.126434:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485695616:12345-0@lo:41: 00000004:00000024:2.0:1788463263.126491:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463263.126670:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485695616:12345-0@lo:41: Request processed in 239us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.126677:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463263.127032:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485695616:0@lo:41: 00000100:00100000:2.0:1788463263.156420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463263.156525:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769408 00000100:00100000:3.0:1788463263.156539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769408 00000100:00100000:3.0:1788463263.156668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 190 00000100:00100000:3.0:1788463263.156682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6179:x1875339466769408:12345-192.168.204.53@tcp:502: 00000100:00100000:3.0:1788463263.156899:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6179:x1875339466769408:12345-192.168.204.53@tcp:502: Request processed in 220us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463263.156909:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 190 00000100:00100000:3.0:1788463263.168812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.169129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769536 00000100:00100000:1.0:1788463263.169145:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769536 00000100:00100000:1.0:1788463263.169216:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 191 00000100:00100000:1.0:1788463263.169228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6160:x1875339466769536:12345-192.168.204.53@tcp:101: 00010000:00010000:1.0:1788463263.169252:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463263.169278:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0da00/0x841acb7f42a39711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765af expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.169318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0da00/0x841acb7f42a39711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765af expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.169332:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0da00/0x841acb7f42a39711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765af expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463263.169344:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0da00, rc 0) 00000100:00100000:1.0:1788463263.169426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6160:x1875339466769536:12345-192.168.204.53@tcp:101: Request processed in 199us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463263.169452:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 191 00000100:00100000:2.0:1788463263.176915:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463263.179488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769664 00000100:00100000:0.0:1788463263.179514:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769664 00000100:00100000:0.0:1788463263.179626:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 192 00000100:00100000:0.0:1788463263.179640:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6160:x1875339466769664:12345-192.168.204.53@tcp:256: 20000000:01000000:0.0:1788463263.179677:0:6518:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788463263.179711:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463263.179716:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788463263.179719:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788463263.179721:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788463263.179724:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788463263.186423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6160:x1875339466769664:12345-192.168.204.53@tcp:256: Request processed in 6765us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463263.186443:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 192 00000100:00100000:2.0:1788463263.194027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463263.194995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769792 00000100:00100000:3.0:1788463263.195014:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769792 00000100:00100000:2.0:1788463263.195698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 193 00000100:00100000:2.0:1788463263.195714:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6160:x1875339466769792:12345-192.168.204.53@tcp:101: 00010000:00010000:2.0:1788463263.195739:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463263.195766:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765b6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.195805:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.195819:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463263.195830:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21c00, rc 0) 00000100:00100000:2.0:1788463263.196032:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6160:x1875339466769792:12345-192.168.204.53@tcp:101: Request processed in 321us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.196040:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 193 00000100:00100000:3.0:1788463263.197983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463263.198372:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466769920 00000100:00100000:2.0:1788463263.198387:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466769920 00000100:00100000:2.0:1788463263.198457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 194 00000100:00100000:2.0:1788463263.198469:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6160:x1875339466769920:12345-192.168.204.53@tcp:501: 00000100:00100000:2.0:1788463263.198713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6160:x1875339466769920:12345-192.168.204.53@tcp:501: Request processed in 245us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.198721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 194 00000100:00100000:3.0:1788463263.201441:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463263.201543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770048 00000100:00100000:2.0:1788463263.201555:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770048 00000100:00100000:2.0:1788463263.201756:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:2.0:1788463263.201771:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6160:x1875339466770048:12345-192.168.204.53@tcp:503: 00000100:00100000:2.0:1788463263.201996:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6160:x1875339466770048:12345-192.168.204.53@tcp:503: Request processed in 229us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.202004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:3.0:1788463263.204515:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.205816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770176 00000100:00100000:1.0:1788463263.205834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770176 00000100:00100000:1.0:1788463263.205913:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:1.0:1788463263.205925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6184:x1875339466770176:12345-192.168.204.53@tcp:502: 00000100:00100000:1.0:1788463263.206344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6184:x1875339466770176:12345-192.168.204.53@tcp:502: Request processed in 419us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463263.206354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:2.0:1788463263.209327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.209420:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770304 00000100:00100000:1.0:1788463263.209433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770304 00000100:00100000:1.0:1788463263.209505:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:1.0:1788463263.209517:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6184:x1875339466770304:12345-192.168.204.53@tcp:502: 00000100:00100000:1.0:1788463263.209914:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6184:x1875339466770304:12345-192.168.204.53@tcp:502: Request processed in 397us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463263.209924:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:2.0:1788463263.214386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463263.214437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463263.214772:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770432 00000100:00100000:1.0:1788463263.214786:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770432 00000100:00100000:1.0:1788463263.214836:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770688 00000100:00100000:1.0:1788463263.214839:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770688 00000100:00100000:1.0:1788463263.214873:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:1.0:1788463263.214883:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875339466770432:12345-192.168.204.53@tcp:38: 00000100:00100000:2.0:1788463263.214974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:2.0:1788463263.214981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875339466770688:12345-192.168.204.53@tcp:38: 00010000:00080000:2.0:1788463263.215020:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:2.0:1788463263.215097:0:6522:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a3971f 00000004:00100000:2.0:1788463263.215134:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788463263.215421:0:6522:0:(import.c:65:import_set_state_nolock()) ffff961786881000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463263.215511:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466770688:12345-192.168.204.53@tcp:38: Request processed in 527us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463263.215519:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00010000:00080000:1.0:1788463263.216939:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:1.0:1788463263.217008:0:6523:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a39726 00000004:00100000:1.0:1788463263.217040:0:6523:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788463263.217320:0:6523:0:(import.c:65:import_set_state_nolock()) ffff961787a5d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463263.217443:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466770432:12345-192.168.204.53@tcp:38: Request processed in 2559us (3070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463263.217454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00010000:00010000:0.0:1788463263.364202:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463264.226399:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463264.226622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770816 00000100:00100000:0.0:1788463264.226636:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770816 00000100:00100000:0.0:1788463264.226751:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463264.226764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466770816:12345-192.168.204.53@tcp:41: 00000004:00000024:0.0:1788463264.226822:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463264.226918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466770816:12345-192.168.204.53@tcp:41: Request processed in 156us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.226926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00080000:1.0:1788463264.227136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463264.230710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463264.231064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463264.248218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770944 00000100:00100000:1.0:1788463264.248242:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770944 00000100:00100000:1.0:1788463264.248374:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466770560 00000100:00100000:1.0:1788463264.248380:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466770560 00000100:00100000:1.0:1788463264.248425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:1.0:1788463264.248438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+7:6160:x1875339466770944:12345-192.168.204.53@tcp:41: 00000004:00000024:1.0:1788463264.248493:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788463264.248621:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+7:6160:x1875339466770944:12345-192.168.204.53@tcp:41: Request processed in 185us (17925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.248630:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:1.0:1788463264.248655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463264.248663:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466770560:12345-192.168.204.53@tcp:41: 00000004:00000024:1.0:1788463264.248675:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788463264.248698:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466770560:12345-192.168.204.53@tcp:41: Request processed in 36us (17635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.248705:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00080000:2.0:1788463264.249472:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463264.257990:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463264.258960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771072 00000100:00100000:1.0:1788463264.258977:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771072 00000100:00100000:1.0:1788463264.259067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:1.0:1788463264.259080:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771072:12345-192.168.204.53@tcp:40: 00000100:00100000:1.0:1788463264.259208:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771072:12345-192.168.204.53@tcp:40: Request processed in 130us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.259239:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:3.0:1788463264.270187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463264.270244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463264.270280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463264.270324:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463264.270410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771584 00000100:00100000:1.0:1788463264.270423:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771584 00000100:00100000:1.0:1788463264.270494:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00100000:1.0:1788463264.270506:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466771584:12345-192.168.204.53@tcp:400: 00000100:00100000:1.0:1788463264.270673:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466771584:12345-192.168.204.53@tcp:400: Request processed in 168us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.270682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00100000:1.0:1788463264.270723:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771200 00000100:00100000:1.0:1788463264.270742:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771200 00000100:00100000:1.0:1788463264.270763:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771328 00000100:00100000:1.0:1788463264.270766:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771328 00000100:00100000:1.0:1788463264.270781:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:1.0:1788463264.270786:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466771200:12345-192.168.204.53@tcp:8: 00010000:00080000:1.0:1788463264.270832:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1788463264.270881:0:8441:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a3972d 00002000:00100000:1.0:1788463264.270896:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68497686-852f-43ff-8be6-586d5980ece4/ffff961787a5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463264.270920:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463264.271154:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463264.271193:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787a5b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463264.271234:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466771200:12345-192.168.204.53@tcp:8: Request processed in 445us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.271241:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:1.0:1788463264.271258:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:1.0:1788463264.271264:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466771328:12345-192.168.204.53@tcp:8: 00010000:00080000:1.0:1788463264.271292:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1788463264.271315:0:8441:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a39734 00002000:00100000:1.0:1788463264.271323:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68497686-852f-43ff-8be6-586d5980ece4/ffff961787059000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463264.271336:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463264.271492:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788463264.271509:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787059800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463264.271535:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466771328:12345-192.168.204.53@tcp:8: Request processed in 269us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.271542:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463264.273288:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771456 00000100:00100000:0.0:1788463264.273305:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771456 00000100:00100000:0.0:1788463264.273458:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:0.0:1788463264.273471:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771456:12345-192.168.204.53@tcp:900: 00000100:00100000:0.0:1788463264.273657:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771456:12345-192.168.204.53@tcp:900: Request processed in 188us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.273666:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463264.280688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463264.281056:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771712 00000100:00100000:1.0:1788463264.281071:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771712 00000100:00100000:1.0:1788463264.281140:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463264.281152:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771712:12345-192.168.204.53@tcp:33: 00000004:00080000:3.0:1788463264.313174:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31901us 00000004:00200000:3.0:1788463264.329012:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788463264.329127:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+6:6160:x1875339466771712:12345-192.168.204.53@tcp:33: Request processed in 47971us (48448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463264.329142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00010000:00010000:0.0:1788463264.396947:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463264.628681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463264.628808:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771840 00000100:00100000:2.0:1788463264.628819:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771840 00000100:00100000:2.0:1788463264.628890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:2.0:1788463264.628902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:6203:x1875339466771840:12345-192.168.204.53@tcp:101: 00010000:00010000:2.0:1788463264.628921:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463264.629001:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3973b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765e7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629070:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629084:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629099:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463264.629415:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463264.629420:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463264.629439:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629467:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3973b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765e7 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629486:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765e7 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463264.629496:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618c0095800) 00010000:00010000:2.0:1788463264.629499:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463264.629516:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463264.629639:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+7:6203:x1875339466771840:12345-192.168.204.53@tcp:101: Request processed in 738us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463264.629646:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00010000:00010000:2.0:1788463265.411751:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463265.669436:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463265.669462:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485695744:0@lo:13: 00000100:00100000:1.0:1788463265.669538:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463265.669695:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695744 00000100:00100000:0.0:1788463265.669704:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695744 00000100:00100000:0.0:1788463265.669787:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463265.669797:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485695744:12345-0@lo:13: 00002000:00000024:0.0:1788463265.669827:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463265.669877:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485695744:12345-0@lo:13: Request processed in 81us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463265.669884:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788463265.670301:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463265.670771:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5d880 x1875339485695744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463265.670792:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485695744:0@lo:13: 00000100:00100000:3.0:1788463266.180374:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463266.180402:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485695872:0@lo:13: 00000100:00100000:3.0:1788463266.180474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463266.180649:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485695872 00000100:00100000:1.0:1788463266.180657:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485695872 00000100:00100000:1.0:1788463266.180733:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463266.180744:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485695872:12345-0@lo:13: 00002000:00000024:1.0:1788463266.180766:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463266.180810:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485695872:12345-0@lo:13: Request processed in 69us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463266.180832:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788463266.180925:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5df80 x1875339485695872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463266.180943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485695872:0@lo:13: 00000100:00080000:2.0:1788463266.182408:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463266.437635:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463266.950472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463266.950567:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466771968 00000100:00100000:1.0:1788463266.950615:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466771968 00000100:00100000:1.0:1788463266.950706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:1.0:1788463266.950718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+7:6255:x1875339466771968:12345-192.168.204.53@tcp:41: 00000004:00000024:1.0:1788463266.950774:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788463266.950871:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+7:6255:x1875339466771968:12345-192.168.204.53@tcp:41: Request processed in 154us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463266.950878:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00080000:2.0:1788463266.950947:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463266.956746:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463266.956997:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772096 00000100:00100000:1.0:1788463266.957007:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772096 00000100:00100000:1.0:1788463266.957149:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:1.0:1788463266.957161:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772096:12345-192.168.204.53@tcp:41: 00000004:00000024:1.0:1788463266.957208:0:10067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463266.957284:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772096:12345-192.168.204.53@tcp:41: Request processed in 125us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463266.957292:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00080000:2.0:1788463266.960848:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463266.967724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463266.967901:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772224 00000100:00100000:1.0:1788463266.967911:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772224 00000100:00080000:2.0:1788463266.968160:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463266.968206:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:1.0:1788463266.968218:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772224:12345-192.168.204.53@tcp:13: 00002000:00000024:1.0:1788463266.968247:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463266.968332:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772224:12345-192.168.204.53@tcp:13: Request processed in 116us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463266.968340:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463266.975393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463266.975517:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772352 00000100:00100000:3.0:1788463266.975537:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772352 00000100:00100000:3.0:1788463266.975678:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:3.0:1788463266.975690:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772352:12345-192.168.204.53@tcp:13: 00002000:00000024:3.0:1788463266.975726:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463266.975785:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:68497686-852f-43ff-8be6-586d5980ece4+6:6255:x1875339466772352:12345-192.168.204.53@tcp:13: Request processed in 97us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463266.975793:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00080000:2.0:1788463266.981054:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463267.204275:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463267.204301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485696000:0@lo:13: 00000100:00100000:2.0:1788463267.204397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.205057:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463267.205069:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485696128:0@lo:13: 00000100:00100000:2.0:1788463267.205104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463267.205556:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696000 00000100:00100000:1.0:1788463267.205566:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696000 00000100:00100000:1.0:1788463267.205653:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696128 00000100:00100000:1.0:1788463267.205657:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696128 00000100:00100000:1.0:1788463267.205676:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463267.205685:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485696000:12345-0@lo:13: 00002000:00000024:1.0:1788463267.205708:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463267.205765:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485696000:12345-0@lo:13: Request processed in 80us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463267.205772:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463267.205789:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463267.205796:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485696128:12345-0@lo:13: 00002000:00000024:1.0:1788463267.205817:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463267.205850:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485696128:12345-0@lo:13: Request processed in 54us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463267.205856:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788463267.207032:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5dc00 x1875339485696128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463267.207054:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485696128:0@lo:13: 00000100:00080000:2.0:1788463267.207084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788463267.207107:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700ea00 x1875339485696000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463267.207120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485696000:0@lo:13: 00000100:00100000:0.0:1788463267.208248:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485696256:0@lo:400: 00000100:00100000:0.0:1788463267.208313:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463267.208362:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485696768:0@lo:400: 00000100:00100000:0.0:1788463267.208389:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463267.208410:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485697280:0@lo:400: 00000100:00100000:0.0:1788463267.208433:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463267.208453:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463267.208460:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485696640:0@lo:400: 00000100:00100000:0.0:1788463267.208483:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463267.208509:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485697152:0@lo:400: 00000100:00100000:0.0:1788463267.208542:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463267.208569:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696768 00000100:00100000:0.0:1788463267.208597:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696768 00000100:00100000:2.0:1788463267.208843:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696256 00000100:00100000:2.0:1788463267.208849:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696256 00000100:00100000:2.0:1788463267.208909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788463267.208926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485696256:12345-0@lo:400: 00000100:00100000:2.0:1788463267.208978:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485696256:12345-0@lo:400: Request processed in 55us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.208986:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788463267.209035:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485696512:0@lo:400: 00000100:00100000:2.0:1788463267.209058:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485697024:0@lo:400: 00000100:00100000:2.0:1788463267.209095:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485697536:0@lo:400: 00000100:00100000:2.0:1788463267.209136:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209154:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788463267.209159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485696384:0@lo:400: 00000100:00100000:2.0:1788463267.209180:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209198:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485696896:0@lo:400: 00000100:00100000:2.0:1788463267.209218:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485697408:0@lo:400: 00000100:00100000:2.0:1788463267.209244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.209263:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696512 00000100:00100000:2.0:1788463267.209267:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696512 00000100:00100000:2.0:1788463267.209294:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463267.209300:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485696512:12345-0@lo:400: 00000100:00100000:2.0:1788463267.209337:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485696512:12345-0@lo:400: Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.209342:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463267.209374:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485696512:0@lo:400: 00000100:00100000:2.0:1788463267.209426:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485696256:0@lo:400: 00000100:00100000:2.0:1788463267.209446:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696640 00000100:00100000:2.0:1788463267.209449:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696640 00000100:00100000:2.0:1788463267.209468:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697024 00000100:00100000:2.0:1788463267.209470:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697024 00000100:00080000:2.0:1788463267.209489:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463267.209500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697536 00000100:00100000:2.0:1788463267.209502:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697536 00000100:00080000:2.0:1788463267.209512:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463267.209537:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696384 00000100:00100000:2.0:1788463267.209540:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696384 00000100:00100000:2.0:1788463267.209550:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485696896 00000100:00100000:2.0:1788463267.209552:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485696896 00000100:00080000:2.0:1788463267.209563:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463267.209597:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697408 00000100:00100000:2.0:1788463267.209601:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697408 00000100:00080000:2.0:1788463267.209625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463267.209642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463267.209648:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485696640:12345-0@lo:400: 00000100:00100000:2.0:1788463267.209684:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485696640:12345-0@lo:400: Request processed in 37us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.209690:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463267.209716:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485696640:0@lo:400: 00000100:00100000:2.0:1788463267.209733:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788463267.209740:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485697024:12345-0@lo:400: 00000100:00100000:2.0:1788463267.209773:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485697024:12345-0@lo:400: Request processed in 34us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.209780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788463267.209814:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5d880 x1875339485697024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463267.209825:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485697024:0@lo:400: 00000100:00100000:2.0:1788463267.209849:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463267.209855:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485697536:12345-0@lo:400: 00000100:00100000:2.0:1788463267.209900:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485697536:12345-0@lo:400: Request processed in 45us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.209906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788463267.209925:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20000 x1875339485697536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463267.209934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485697536:0@lo:400: 00000100:00100000:2.0:1788463267.209949:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463267.209955:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485696384:12345-0@lo:400: 00000100:00100000:2.0:1788463267.209980:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485696384:12345-0@lo:400: Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.209986:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463267.210004:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485696384:0@lo:400: 00000100:00100000:2.0:1788463267.210019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788463267.210025:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485696896:12345-0@lo:400: 00000100:00100000:2.0:1788463267.210052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485696896:12345-0@lo:400: Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.210058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788463267.210078:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485696896:0@lo:400: 00000100:00100000:2.0:1788463267.210092:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463267.210108:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485697408:12345-0@lo:400: 00000100:00100000:2.0:1788463267.210139:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485697408:12345-0@lo:400: Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.210145:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463267.210167:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485697408:0@lo:400: 00000100:00100000:0.0:1788463267.210866:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463267.210877:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485696768:12345-0@lo:400: 00000100:00100000:0.0:1788463267.211067:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485696768:12345-0@lo:400: Request processed in 190us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463267.211074:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463267.211113:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485696768:0@lo:400: 00000100:00100000:1.0:1788463267.214269:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697280 00000100:00100000:1.0:1788463267.214285:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697280 00000100:00100000:1.0:1788463267.214353:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697152 00000100:00100000:1.0:1788463267.214357:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697152 00000100:00100000:1.0:1788463267.214414:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463267.214425:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485697280:12345-0@lo:400: 00000100:00100000:1.0:1788463267.214561:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485697280:12345-0@lo:400: Request processed in 137us (6125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463267.214568:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463267.214633:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463267.214640:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485697152:12345-0@lo:400: 00000100:00100000:1.0:1788463267.214672:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485697152:12345-0@lo:400: Request processed in 33us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463267.214685:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788463267.214739:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc22d80 x1875339485697152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463267.214755:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485697152:0@lo:400: 00010000:00080000:1.0:1788463267.214768:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc23100 x1875339485697280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463267.214777:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485697280:0@lo:400: 00000100:00080000:3.0:1788463267.215400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463267.462390:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463267.720339:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485697664:0@lo:41: 00000100:00100000:1.0:1788463267.720416:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463267.722005:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697664 00000100:00100000:2.0:1788463267.722019:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697664 00000100:00100000:2.0:1788463267.722086:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788463267.722098:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485697664:12345-0@lo:41: 00000004:00000024:2.0:1788463267.722145:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788463267.722228:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485697664:12345-0@lo:41: Request processed in 132us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463267.722235:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463267.722327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485697664:0@lo:41: 00000100:00100000:3.0:1788463268.232869:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463268.232895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485697792:0@lo:41: 00000100:00100000:3.0:1788463268.232963:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463268.233130:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697792 00000100:00100000:0.0:1788463268.233138:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697792 00000100:00100000:0.0:1788463268.233193:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463268.233203:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485697792:12345-0@lo:41: 00000004:00000024:0.0:1788463268.233236:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463268.233292:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485697792:12345-0@lo:41: Request processed in 90us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463268.233299:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463268.233376:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485697792:0@lo:41: 00010000:00010000:2.0:1788463268.483970:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463268.741556:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000001:00100000:1.0:1788463268.742454:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000001:00100000:3.0:1788463268.743320:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00010000:00010000:0.0:1788463269.511058:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463269.616638:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463269.616681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463269.616731:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463269.616755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463269.616792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463269.616972:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772736 00000100:00100000:2.0:1788463269.616984:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772736 00000100:00100000:2.0:1788463269.617048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772608 00000100:00100000:2.0:1788463269.617052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772608 00000100:00100000:2.0:1788463269.617076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:2.0:1788463269.617091:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466772736:12345-192.168.204.53@tcp:400: 00000100:00100000:2.0:1788463269.617169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466772736:12345-192.168.204.53@tcp:400: Request processed in 84us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463269.617176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:2.0:1788463269.617193:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:2.0:1788463269.617200:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466772608:12345-192.168.204.53@tcp:400: 00000100:00100000:2.0:1788463269.617226:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466772608:12345-192.168.204.53@tcp:400: Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463269.617240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:0.0:1788463269.617393:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772992 00000100:00100000:0.0:1788463269.617403:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772992 00000100:00100000:0.0:1788463269.617442:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772864 00000100:00100000:0.0:1788463269.617445:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772864 00000100:00100000:0.0:1788463269.617467:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:0.0:1788463269.617487:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466772992:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463269.617520:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466772992:12345-192.168.204.53@tcp:400: Request processed in 36us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463269.617527:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:0.0:1788463269.617540:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:0.0:1788463269.617547:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466772864:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463269.617571:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466772864:12345-192.168.204.53@tcp:400: Request processed in 25us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463269.617606:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:3.0:1788463269.617878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466772480 00000100:00100000:3.0:1788463269.617883:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466772480 00000100:00100000:3.0:1788463269.617948:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 200 00000100:00100000:3.0:1788463269.617956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2403:x1875339466772480:12345-192.168.204.53@tcp:400: 00000100:00100000:3.0:1788463269.617999:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2403:x1875339466772480:12345-192.168.204.53@tcp:400: Request processed in 44us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463269.618006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 200 00000100:00080000:3.0:1788463269.618039:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463269.618044:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463269.618047:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463269.618050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788463270.062476:0:10191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788463270.290887:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00010000:00010000:0.0:1788463270.532613:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463270.790507:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463270.790536:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485697920:0@lo:13: 00000100:00100000:0.0:1788463270.790639:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463270.790739:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485697920 00000100:00100000:2.0:1788463270.790750:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485697920 00000100:00100000:2.0:1788463270.790822:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788463270.790860:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463270.790897:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485697920:12345-0@lo:13: 00002000:00000024:2.0:1788463270.790928:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463270.791003:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485697920:12345-0@lo:13: Request processed in 162us (353us total) trans 0 rc 0/0 00010000:00080000:0.0:1788463270.791061:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20000 x1875339485697920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463270.791081:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485697920:0@lo:13: 00000100:00100000:2.0:1788463270.793864:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463271.300565:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485698048:0@lo:13: 00000100:00100000:0.0:1788463271.300693:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463271.300856:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698048 00000100:00100000:3.0:1788463271.300865:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698048 00000100:00100000:3.0:1788463271.300925:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463271.300949:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485698048:12345-0@lo:13: 00002000:00000024:3.0:1788463271.300976:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463271.301028:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485698048:12345-0@lo:13: Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463271.301035:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788463271.301074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20700 x1875339485698048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463271.301091:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485698048:0@lo:13: 00000100:00080000:0.0:1788463271.301159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463271.560419:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463272.323826:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485698176:0@lo:13: 00000100:00100000:2.0:1788463272.323924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463272.324027:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698176 00000100:00100000:2.0:1788463272.324037:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698176 00000100:00100000:2.0:1788463272.324106:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463272.324122:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485698176:12345-0@lo:13: 00002000:00000024:2.0:1788463272.324161:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463272.324224:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485698176:12345-0@lo:13: Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463272.324232:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788463272.324262:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788463272.324312:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc22680 x1875339485698176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463272.324336:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485698176:0@lo:13: 00000100:00100000:2.0:1788463272.324365:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485698688:0@lo:400: 00000100:00100000:2.0:1788463272.324410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.324448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485698432:0@lo:400: 00000100:00100000:2.0:1788463272.324465:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485699200:0@lo:400: 00000100:00100000:2.0:1788463272.324524:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463272.324648:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485698560:0@lo:400: 00000100:00100000:0.0:1788463272.327295:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.327765:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485698944:0@lo:400: 00000100:00100000:0.0:1788463272.327856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.327899:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485699456:0@lo:400: 00000100:00100000:0.0:1788463272.327924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.328091:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698688 00000100:00100000:0.0:1788463272.328100:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698688 00000100:00100000:0.0:1788463272.328140:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698432 00000100:00100000:0.0:1788463272.328143:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698432 00000100:00100000:0.0:1788463272.328153:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698944 00000100:00100000:0.0:1788463272.328156:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698944 00000100:00100000:0.0:1788463272.328176:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699456 00000100:00100000:0.0:1788463272.328179:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699456 00000100:00100000:0.0:1788463272.328197:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463272.328845:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485698688:12345-0@lo:400: 00000100:00100000:0.0:1788463272.328942:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485698688:12345-0@lo:400: Request processed in 93us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.328949:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463272.328972:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463272.328979:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485698432:12345-0@lo:400: 00000100:00100000:0.0:1788463272.329015:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485698432:12345-0@lo:400: Request processed in 37us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.329021:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463272.329032:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788463272.329038:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485698944:12345-0@lo:400: 00000100:00100000:0.0:1788463272.329064:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485698944:12345-0@lo:400: Request processed in 26us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.329084:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788463272.329096:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463272.329101:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485699456:12345-0@lo:400: 00000100:00100000:0.0:1788463272.329130:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485699456:12345-0@lo:400: Request processed in 29us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.329135:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788463272.329162:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463272.329212:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787853b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485698432:0@lo:400: 00000100:00100000:0.0:1788463272.329225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485698944:0@lo:400: 00000100:00100000:0.0:1788463272.329234:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485699456:0@lo:400: 00000100:00100000:0.0:1788463272.329291:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485698304:0@lo:400: 00000100:00100000:0.0:1788463272.329325:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.329362:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485698816:0@lo:400: 00000100:00100000:0.0:1788463272.329386:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.329406:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699328:0@lo:400: 00000100:00100000:0.0:1788463272.329441:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.329471:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699840:0@lo:13: 00000100:00100000:0.0:1788463272.329505:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.329527:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463272.329533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699712:0@lo:400: 00000100:00100000:0.0:1788463272.329563:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463272.329628:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698816 00000100:00100000:0.0:1788463272.329633:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698816 00000100:00100000:0.0:1788463272.329666:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463272.329682:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485698816:12345-0@lo:400: 00000100:00100000:0.0:1788463272.329721:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485698816:12345-0@lo:400: Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.329728:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463272.330272:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699200 00000100:00100000:0.0:1788463272.330401:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699200 00000100:00100000:0.0:1788463272.330463:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699328 00000100:00100000:0.0:1788463272.330467:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699328 00000100:00100000:0.0:1788463272.330478:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699712 00000100:00100000:0.0:1788463272.330608:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699712 00000100:00100000:0.0:1788463272.330689:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463272.330697:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485699200:12345-0@lo:400: 00000100:00100000:0.0:1788463272.330818:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485699200:12345-0@lo:400: Request processed in 52us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.330825:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463272.330839:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463272.330845:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699328:12345-0@lo:400: 00000100:00100000:0.0:1788463272.330876:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699328:12345-0@lo:400: Request processed in 32us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.330882:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463272.330893:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463272.330899:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699712:12345-0@lo:400: 00000100:00100000:0.0:1788463272.330925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699712:12345-0@lo:400: Request processed in 26us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463272.330940:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788463272.330969:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463272.330975:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463272.330993:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699840 00000100:00100000:0.0:1788463272.331009:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699840 00000100:00100000:1.0:1788463272.331165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698304 00000100:00100000:1.0:1788463272.331190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698304 00000100:00100000:1.0:1788463272.331250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788463272.331260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485698304:12345-0@lo:400: 00000100:00100000:1.0:1788463272.331332:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485698304:12345-0@lo:400: Request processed in 73us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.331340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788463272.331405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463272.331449:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485698560 00000100:00100000:1.0:1788463272.331454:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485698560 00000100:00100000:1.0:1788463272.331482:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463272.331488:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485698560:12345-0@lo:400: 00000100:00100000:1.0:1788463272.331535:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485698560:12345-0@lo:400: Request processed in 47us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.331543:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463272.331612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485698560:0@lo:400: 00000100:00100000:1.0:1788463272.331626:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485699072:0@lo:400: 00000100:00100000:1.0:1788463272.331661:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463272.331688:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699072 00000100:00100000:1.0:1788463272.331691:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699072 00000100:00100000:0.0:1788463272.331720:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463272.331736:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699840:12345-0@lo:13: 00002000:00000024:0.0:1788463272.331753:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463272.331806:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485699840:12345-0@lo:13: Request processed in 69us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.333046:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463272.333062:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485699072:12345-0@lo:400: 00000100:00100000:1.0:1788463272.333353:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485699072:12345-0@lo:400: Request processed in 295us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.333361:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788463272.333397:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463272.333450:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787850700 x1875339485699072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463272.333466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485699072:0@lo:400: 00000100:00100000:1.0:1788463272.333478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485699584:0@lo:400: 00000100:00100000:1.0:1788463272.333517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463272.333549:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699584 00000100:00100000:1.0:1788463272.333558:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699584 00000100:00100000:1.0:1788463272.333618:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463272.333625:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485699584:12345-0@lo:400: 00000100:00100000:1.0:1788463272.333658:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485699584:12345-0@lo:400: Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.333693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788463272.333848:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463272.333869:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787851180 x1875339485699584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463272.333880:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485699584:0@lo:400: 00010000:00080000:1.0:1788463272.333963:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787850380 x1875339485699712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463272.333974:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699712:0@lo:400: 00000100:00100000:1.0:1788463272.333990:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485698304:0@lo:400: 00000100:00100000:1.0:1788463272.334002:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485698816:0@lo:400: 00010000:00080000:1.0:1788463272.334017:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787852300 x1875339485699328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463272.334026:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699328:0@lo:400: 00010000:00080000:1.0:1788463272.334036:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700f480 x1875339485699840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463272.334056:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485699840:0@lo:13: 00000100:00100000:0.0:1788463272.338965:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788463272.339215:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787852680 x1875339485699200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463272.339239:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485699200:0@lo:400: 00000100:00100000:3.0:1788463272.339292:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485698688:0@lo:400: 00010000:00010000:0.0:1788463272.583001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463272.835942:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485699968:0@lo:41: 00000100:00100000:2.0:1788463272.836017:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463272.836151:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485699968 00000100:00100000:1.0:1788463272.836159:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485699968 00000100:00100000:1.0:1788463272.836225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463272.836234:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485699968:12345-0@lo:41: 00000004:00000024:1.0:1788463272.836269:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788463272.836323:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485699968:12345-0@lo:41: Request processed in 90us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463272.836343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463272.836405:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485699968:0@lo:41: 00000100:00100000:1.0:1788463273.349871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485700096:0@lo:41: 00000100:00100000:1.0:1788463273.349944:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463273.350025:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700096 00000100:00100000:1.0:1788463273.350033:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700096 00000100:00100000:1.0:1788463273.350090:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463273.350098:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485700096:12345-0@lo:41: 00000004:00000024:1.0:1788463273.350135:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463273.350180:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485700096:12345-0@lo:41: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463273.350187:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463273.350245:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485700096:0@lo:41: 00010000:00010000:0.0:1788463273.604916:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463274.508781:0:10339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc30809340 20000000:00000080:2.0:1788463274.508798:0:10339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96188facfc00 uarg=0000000000000000 20000000:01000000:2.0:1788463274.509817:0:10339:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788463274.509820:0:10339:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788463274.509824:0:10339:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788463274.509839:0:10339:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788463274.509845:0:10339:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788463274.509918:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788463274.509921:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788463274.511107:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788463274.514936:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788463274.514975:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788463274.514992:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788463274.515072:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788463274.515075:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788463274.516679:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788463274.516867:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788463274.516915:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788463274.516933:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788463274.516945:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788463274.516947:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788463274.519424:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788463274.519864:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788463274.519898:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788463274.519917:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788463274.519930:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788463274.519933:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788463274.520891:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788463274.521161:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788463274.521192:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788463274.521209:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788463274.521223:0:10339:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788463274.521226:0:10339:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788463274.523074:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788463274.523487:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788463274.523519:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788463274.523534:0:10339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788463274.523553:0:10339:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788463274.523605:0:10339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523625:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395dd expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523632:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39607 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523647:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39646 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523653:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39654 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523660:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39662 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523665:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523671:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523676:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523682:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a396ee expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523691:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523697:0:10339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523704:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523747:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.523760:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 9 pid: 6516 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.523774:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700224:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463274.524116:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524125:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524134:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700352:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463274.524169:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524178:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 23 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524188:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700480:0@lo:104: 00000100:00100000:2.0:1788463274.524225:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463274.524259:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524267:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 23 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524286:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700608:0@lo:104: 00000100:00100000:2.0:1788463274.524392:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463274.524414:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524423:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524431:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700736:0@lo:104: 00000100:00100000:2.0:1788463274.524448:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.524465:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700480 00010000:00010000:2.0:1788463274.524466:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524475:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700480 00010000:00010000:2.0:1788463274.524477:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524488:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700864:0@lo:104: 00000100:00100000:2.0:1788463274.524511:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463274.524527:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524527:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788463274.524540:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524543:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700608 00000100:00100000:0.0:1788463274.524548:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700608 00000100:00100000:2.0:1788463274.524553:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700992:0@lo:104: 00000100:00100000:0.0:1788463274.524562:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700736 00000100:00100000:0.0:1788463274.524566:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700736 00000100:00100000:2.0:1788463274.524600:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.524601:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700864 00000100:00100000:0.0:1788463274.524605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700864 00010000:00010000:2.0:1788463274.524626:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524631:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485700992 00000100:00100000:0.0:1788463274.524635:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485700992 00010000:00010000:2.0:1788463274.524647:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524656:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463274.524658:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701120:0@lo:104: 00000100:00100000:0.0:1788463274.524679:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:10339:x1875339485700480:12345-0@lo:104: 00000100:00100000:2.0:1788463274.524686:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463274.524699:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524705:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.524720:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 23 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524728:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701248:0@lo:104: 00000100:00100000:2.0:1788463274.524755:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463274.524776:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463274.524785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:10339:x1875339485700480:12345-0@lo:104: Request processed in 117us (559us total) trans 0 rc 0/0 00010000:00010000:2.0:1788463274.524790:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524796:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788463274.524802:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 23 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524815:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701376:0@lo:104: 00000100:00100000:0.0:1788463274.524825:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701120 00000100:00100000:0.0:1788463274.524830:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701120 00000100:00100000:0.0:1788463274.524849:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701248 00000100:00100000:2.0:1788463274.524853:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.524854:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701248 00000100:00100000:0.0:1788463274.524869:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701376 00000100:00100000:0.0:1788463274.524872:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701376 00010000:00010000:2.0:1788463274.524881:0:10339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524889:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788463274.524893:0:10339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 23 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.524901:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:10339:x1875339485700608:12345-0@lo:104: 00000100:00100000:2.0:1788463274.524907:0:10339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701504:0@lo:104: 00010000:00010000:0.0:1788463274.524912:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.524945:0:10339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463274.524966:0:10339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788463274.524967:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463274.524976:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:10339:x1875339485700608:12345-0@lo:104: Request processed in 78us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.524983:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463274.524993:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700480:0@lo:104: 00000100:00100000:0.0:1788463274.524995:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701504 00000100:00100000:0.0:1788463274.524999:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701504 00000100:00100000:0.0:1788463274.525011:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463274.525016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:10339:x1875339485700736:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525023:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525069:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463274.525075:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+9:10339:x1875339485700736:12345-0@lo:104: Request processed in 59us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525081:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463274.525096:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463274.525102:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+8:10339:x1875339485700864:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525112:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525150:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788463274.525155:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+8:10339:x1875339485700864:12345-0@lo:104: Request processed in 54us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525161:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463274.525194:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463274.525201:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:10339:x1875339485700992:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525209:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525234:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788463274.525238:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+7:10339:x1875339485700992:12345-0@lo:104: Request processed in 39us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525244:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463274.525255:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463274.525262:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:10339:x1875339485701120:12345-0@lo:104: 00000100:00100000:2.0:1788463274.525270:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700608:0@lo:104: 00010000:00010000:0.0:1788463274.525270:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.525281:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700736:0@lo:104: 00000100:00100000:2.0:1788463274.525288:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700864:0@lo:104: 00000100:00100000:2.0:1788463274.525295:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700992:0@lo:104: 00010000:00010000:0.0:1788463274.525317:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788463274.525323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:10339:x1875339485701120:12345-0@lo:104: Request processed in 62us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525329:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463274.525338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463274.525343:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:10339:x1875339485701248:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525350:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.525392:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701120:0@lo:104: 00010000:00010000:0.0:1788463274.525395:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788463274.525403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:10339:x1875339485701248:12345-0@lo:104: Request processed in 59us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463274.525404:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701248:0@lo:104: 00000100:00100000:0.0:1788463274.525415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463274.525429:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463274.525434:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10339:x1875339485701376:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525442:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525479:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788463274.525484:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10339:x1875339485701376:12345-0@lo:104: Request processed in 50us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525489:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463274.525502:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463274.525507:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10339:x1875339485701504:12345-0@lo:104: 00010000:00010000:0.0:1788463274.525514:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525540:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788463274.525545:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10339:x1875339485701504:12345-0@lo:104: Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.525550:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788463274.525565:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788463274.525571:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525607:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0de00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.525611:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525620:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.525627:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.525633:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463274.525678:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525686:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788463274.525690:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701376:0@lo:104: 00000100:00100000:2.0:1788463274.525698:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485701504:0@lo:104: 00010000:00010000:0.0:1788463274.525707:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525716:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0de00/0x841acb7f42a396ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525730:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788463274.525733:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525739:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.525742:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525759:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.525765:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.525771:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463274.525797:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525803:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.525809:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525815:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e20800/0x841acb7f42a396c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396cb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525826:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788463274.525830:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525836:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.525839:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525845:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.525851:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.525864:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463274.525889:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525896:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.525920:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525927:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a396a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a396af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525938:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788463274.525941:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525947:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880031e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.525950:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.525958:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.525965:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485701888:0@lo:103: 10000000:00010000:0.0:1788463274.525965:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.525977:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463274.526000:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526006:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526017:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526023:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880031e00/0x841acb7f42a3967e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39685 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526033:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788463274.526036:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526042:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.526045:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526051:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.526057:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.526063:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463274.526075:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526080:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526085:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526092:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a39662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39669 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526100:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788463274.526109:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526115:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.526119:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.526127:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463274.526133:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.526141:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.526147:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788463274.526172:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788463274.526172:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.526180:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485702016:0@lo:103: 00010000:00010000:0.0:1788463274.526182:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526190:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526198:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030e00/0x841acb7f42a39654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3965b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.526208:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463274.526214:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463274.526219:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526225:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.526229:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526245:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.526252:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.526257:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788463274.526269:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701888 00010000:00010000:0.0:1788463274.526272:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526275:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701888 00010000:00010000:0.0:1788463274.526281:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526298:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526305:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a39646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3964d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526309:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 24 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526316:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463274.526321:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526327:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207f400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.526330:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526336:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702016 00010000:00010000:0.0:1788463274.526338:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526340:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702016 10000000:00010000:0.0:1788463274.526348:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526354:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 25 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.526370:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788463274.526398:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788463274.526400:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526409:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+25:3648:x1875339485701888:12345-0@lo:103: 00010000:00010000:0.0:1788463274.526409:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526417:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526424:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463274.526426:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207f400/0x841acb7f42a39607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3960e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526432:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 25 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526439:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463274.526445:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526453:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 25 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526455:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463274.526460:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526469:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526475:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030800/0x841acb7f42a396af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a396a8 expref: 25 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463274.526478:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463274.526491:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463274.526497:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463274.526503:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526509:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463274.526520:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.526527:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207e400/0x841acb7f42a395dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a395e4 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526533:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485701888:12345-0@lo:103: Request processed in 126us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.526542:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788463274.526546:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463274.526550:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463274.526552:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463274.526561:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463274.526568:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463274.526596:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485701760:0@lo:103: 00000100:00100000:1.0:1788463274.526616:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463274.526624:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3648:x1875339485702016:12345-0@lo:103: 00000100:00100000:0.0:1788463274.526632:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463274.526633:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463274.526640:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526649:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526659:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702272:0@lo:103: 00010000:00010000:1.0:1788463274.526662:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5200/0x841acb7f42a39685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3967e expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.526674:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463274.526686:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.526706:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463274.526708:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3648:x1875339485702016:12345-0@lo:103: Request processed in 84us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.526714:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485701632:0@lo:103: 00000100:00100000:1.0:1788463274.526719:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463274.526734:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701760 00000100:00100000:1.0:1788463274.526738:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701760 00000100:00100000:0.0:1788463274.526744:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.526760:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702144:0@lo:103: 00010000:00010000:1.0:1788463274.526762:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 22 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526777:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702272 00000100:00100000:1.0:1788463274.526780:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702272 00000100:00100000:0.0:1788463274.526789:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463274.526792:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 23 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526804:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702656:0@lo:103: 00000100:00100000:1.0:1788463274.526806:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485701632 00000100:00100000:1.0:1788463274.526811:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485701632 00010000:00010000:1.0:1788463274.526826:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 24 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526836:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463274.526844:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702144 00000100:00100000:1.0:1788463274.526847:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702144 00010000:00010000:1.0:1788463274.526861:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 25 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526863:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485702528:0@lo:103: 00000100:00100000:1.0:1788463274.526880:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702656 00000100:00100000:1.0:1788463274.526883:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702656 00000100:00100000:0.0:1788463274.526897:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463274.526898:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 26 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526912:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702528 00000100:00100000:0.0:1788463274.526913:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463274.526915:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702528 00000100:00100000:0.0:1788463274.526922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485702400:0@lo:103: 00010000:00010000:1.0:1788463274.526929:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 27 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.526948:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463274.526951:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463274.526957:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3651:x1875339485701760:12345-0@lo:103: 00010000:00010000:1.0:1788463274.526967:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463274.526972:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 27 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702400 00010000:00010000:1.0:1788463274.526986:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 27 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.526991:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702400 00010000:00010000:0.0:1788463274.527011:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 28 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.527028:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463274.527033:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+28:3651:x1875339485702272:12345-0@lo:103: 00010000:00010000:0.0:1788463274.527041:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463274.527046:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 28 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.527055:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 28 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.527066:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030c00/0x841acb7f42a3965b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39654 expref: 28 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.527076:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463274.527102:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3651:x1875339485702272:12345-0@lo:103: Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.527108:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463274.527120:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463274.527125:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+26:3651:x1875339485701632:12345-0@lo:103: 00010000:00010000:0.0:1788463274.527132:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463274.527137:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207f800/0x841acb7f42a396cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a396c4 expref: 26 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.527139:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 26 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.527159:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 25 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.527225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485702016:0@lo:103: 00000100:00100000:2.0:1788463274.527233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485701888:0@lo:103: 00000100:00100000:2.0:1788463274.529897:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700224:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463274.530044:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463274.530062:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21a00/0x841acb7f42a396f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a396ee expref: 25 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530078:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463274.530096:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485701760:12345-0@lo:103: Request processed in 3138us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.530107:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463274.530120:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485701632:12345-0@lo:103: Request processed in 2993us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.530130:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463274.530142:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463274.530153:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463274.530156:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3651:x1875339485702144:12345-0@lo:103: 00000100:00100000:0.0:1788463274.530166:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3651:x1875339485702656:12345-0@lo:103: 00010000:00010000:1.0:1788463274.530175:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463274.530179:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463274.530184:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 22 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530189:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 22 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530203:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 22 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530215:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 22 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530230:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a39669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39662 expref: 22 pid: 6516 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530235:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20400/0x841acb7f42a395e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a395dd expref: 22 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530245:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463274.530249:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463274.530277:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3651:x1875339485702144:12345-0@lo:103: Request processed in 125us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.530287:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463274.530288:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3651:x1875339485702656:12345-0@lo:103: Request processed in 123us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.530297:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463274.530313:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463274.530320:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463274.530323:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485702528:12345-0@lo:103: 00000100:00100000:1.0:1788463274.530333:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:3649:x1875339485702400:12345-0@lo:103: 00010000:00010000:0.0:1788463274.530334:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463274.530341:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 18 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530359:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463274.530361:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 18 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530368:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 18 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530389:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207fa00/0x841acb7f42a3960e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39607 expref: 18 pid: 6517 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.530398:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463274.530470:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530481:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4800/0x841acb7f42a3964d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39646 expref: 17 pid: 6518 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.530491:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463274.530495:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cde450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:3649:x1875339485702528:12345-0@lo:103: Request processed in 172us (3597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.530504:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463274.530525:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:3649:x1875339485702400:12345-0@lo:103: Request processed in 195us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.530533:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463274.530783:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485701632:0@lo:103: 00000100:00100000:2.0:1788463274.532661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485702528:0@lo:103: 00000100:00100000:2.0:1788463274.532862:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485702400:0@lo:103: 00000100:00100000:1.0:1788463274.533260:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702144:0@lo:103: 00000100:00100000:1.0:1788463274.533272:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702656:0@lo:103: 00000100:00100000:1.0:1788463274.533281:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485701760:0@lo:103: 00000100:00100000:1.0:1788463274.533289:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485702272:0@lo:103: 00000100:00100000:0.0:1788463274.539168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463274.539272:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773120 00000100:00100000:1.0:1788463274.539282:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773120 00010000:00010000:1.0:1788463274.539332:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 10 pid: 6516 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463274.539396:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:1.0:1788463274.539408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466773120:12345-192.168.204.53@tcp:103: 00010000:00010000:1.0:1788463274.539424:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463274.539442:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 10 pid: 6516 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.539454:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 10 pid: 6516 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.539473:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c200/0x841acb7f42a3970a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47657e expref: 10 pid: 6516 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463274.539487:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463274.539538:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:2401:x1875339466773120:12345-192.168.204.53@tcp:103: Request processed in 132us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.539546:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463274.539713:0:10339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10339:1875339485700352:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463274.539785:0:10339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463274.539940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463274.540220:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773248 00000100:00100000:2.0:1788463274.540225:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773248 00010000:00010000:2.0:1788463274.540247:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463274.540278:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:2.0:1788463274.540287:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:2400:x1875339466773248:12345-192.168.204.53@tcp:103: 00010000:00010000:2.0:1788463274.540295:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463274.540301:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540312:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540324:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20600/0x841acb7f42a39703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476577 expref: 9 pid: 6517 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540337:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540346:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540361:0:9527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540369:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540395:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540403:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540409:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463274.540414:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.540423:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.541668:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463274.541688:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463274.541735:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:2400:x1875339466773248:12345-192.168.204.53@tcp:103: Request processed in 1447us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463274.541743:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00010000:00010000:0.0:1788463274.542136:0:10339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.542147:0:10339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.542155:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20000/0x841acb7f42a39749 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463274.629742:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463274.737821:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463274.737858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463274.737882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463274.737910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463274.737936:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773760 00000100:00100000:0.0:1788463274.737951:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773760 00000100:00100000:0.0:1788463274.738013:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773632 00000100:00100000:0.0:1788463274.738016:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773632 00000100:00100000:0.0:1788463274.738040:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463274.738051:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773760:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463274.738119:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773760:12345-192.168.204.53@tcp:400: Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.738140:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463274.738158:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:0.0:1788463274.738164:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773632:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463274.738192:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773632:12345-192.168.204.53@tcp:400: Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.738197:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:0.0:1788463274.738214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773504 00000100:00100000:0.0:1788463274.738218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773504 00000100:00100000:0.0:1788463274.738246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773376 00000100:00100000:0.0:1788463274.738250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773376 00000100:00100000:0.0:1788463274.738272:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:0.0:1788463274.738279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773504:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463274.738305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466773504:12345-192.168.204.53@tcp:400: Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.738310:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:0.0:1788463274.738321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:0.0:1788463274.738327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466773376:12345-192.168.204.53@tcp:400: 00000100:00100000:0.0:1788463274.738347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466773376:12345-192.168.204.53@tcp:400: Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.738362:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00080000:1.0:1788463274.739050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463274.739056:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463274.739059:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463274.739061:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463275.652189:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788463275.844236:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463275.844245:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188f993000 from 48 10000000:01000000:0.0:1788463275.844251:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463275.844305:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.844316:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.844327:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.844362:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485702784:0@lo:101: 00000100:00100000:0.0:1788463275.844438:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.844613:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.848011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702784 00000100:00100000:2.0:1788463275.848037:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702784 00000100:00100000:2.0:1788463275.848133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788463275.848145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+15:6520:x1875339485702784:12345-0@lo:101: 00010000:00010000:2.0:1788463275.848163:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463275.848190:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20e00/0x841acb7f42a39757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39750 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.848222:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20e00/0x841acb7f42a39757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39750 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.848252:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20e00/0x841acb7f42a39757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39750 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.848262:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20e00, rc 0) 00000100:00100000:2.0:1788463275.848372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485702784:12345-0@lo:101: Request processed in 229us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.848378:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788463275.849042:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485702784:0@lo:101: 00010000:00010000:0.0:1788463275.849066:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.849078:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.849169:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485702912:0@lo:501: 00000100:00100000:0.0:1788463275.849209:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.849254:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.849309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485702912 00000100:00100000:1.0:1788463275.849315:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485702912 00000100:00100000:1.0:1788463275.849367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788463275.849377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485702912:12345-0@lo:501: 00000100:00100000:1.0:1788463275.849519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485702912:12345-0@lo:501: Request processed in 144us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.849526:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788463275.849892:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485702912:0@lo:501: 00000100:00100000:0.0:1788463275.849931:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703040:0@lo:503: 00000100:00100000:0.0:1788463275.849990:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.850030:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.850112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703040 00000100:00100000:1.0:1788463275.850117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703040 00000100:00100000:1.0:1788463275.850156:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788463275.850163:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485703040:12345-0@lo:503: 00000100:00100000:1.0:1788463275.850253:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485703040:12345-0@lo:503: Request processed in 89us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.850265:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788463275.850422:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703040:0@lo:503: 00000100:00100000:3.0:1788463275.860633:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10356:1875339485703168:0@lo:502: 00000100:00100000:3.0:1788463275.861231:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463275.861373:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.863930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703168 00000100:00100000:2.0:1788463275.863945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703168 00000100:00100000:2.0:1788463275.864134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788463275.864145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:10356:x1875339485703168:12345-0@lo:502: 00000100:00100000:2.0:1788463275.864476:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:10356:x1875339485703168:12345-0@lo:502: Request processed in 333us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.864484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788463275.868946:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10356:1875339485703168:0@lo:502: 00000100:00100000:3.0:1788463275.869517:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10356:1875339485703296:0@lo:502: 00000100:00100000:3.0:1788463275.869617:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463275.869718:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.872309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703296 00000100:00100000:1.0:1788463275.872324:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703296 00000100:00100000:1.0:1788463275.872477:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788463275.872488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:10356:x1875339485703296:12345-0@lo:502: 00000100:00100000:1.0:1788463275.872697:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:10356:x1875339485703296:12345-0@lo:502: Request processed in 210us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.872705:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788463275.872812:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10356:1875339485703296:0@lo:502: 00000040:00080000:3.0:1788463275.872855:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788463275.875458:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788463275.875493:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463275.875505:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.875518:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463275.875531:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788463275.875534:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788463275.875537:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788463275.875614:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.875622:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.875633:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.875657:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703424:0@lo:101: 00000100:00100000:0.0:1788463275.875723:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.876411:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.876488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703424 00000100:00100000:2.0:1788463275.876496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703424 00000100:00100000:2.0:1788463275.876542:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788463275.876552:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+16:6520:x1875339485703424:12345-0@lo:101: 00010000:00010000:2.0:1788463275.876568:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463275.876600:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21e00/0x841acb7f42a39765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3975e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.876627:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21e00/0x841acb7f42a39765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3975e expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.876640:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21e00/0x841acb7f42a39765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3975e expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.876670:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21e00, rc 0) 00000100:00100000:2.0:1788463275.876727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485703424:12345-0@lo:101: Request processed in 176us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.876734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788463275.876827:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703424:0@lo:101: 00010000:00010000:0.0:1788463275.876851:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.876860:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.876920:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703552:0@lo:501: 00000100:00100000:0.0:1788463275.876959:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.876990:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.877217:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703552 00000100:00100000:2.0:1788463275.877221:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703552 00000100:00100000:2.0:1788463275.877244:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788463275.877250:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485703552:12345-0@lo:501: 00000100:00100000:2.0:1788463275.877395:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485703552:12345-0@lo:501: Request processed in 144us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.877402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788463275.877476:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703552:0@lo:501: 00000100:00100000:0.0:1788463275.877506:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703680:0@lo:503: 00000100:00100000:0.0:1788463275.877548:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.877638:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.877691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703680 00000100:00100000:1.0:1788463275.877696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703680 00000100:00100000:3.0:1788463275.877765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788463275.877776:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485703680:12345-0@lo:503: 00000100:00100000:3.0:1788463275.877866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485703680:12345-0@lo:503: Request processed in 92us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463275.877873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788463275.877941:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485703680:0@lo:503: 00000100:00100000:0.0:1788463275.878165:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10357:1875339485703808:0@lo:502: 00000100:00100000:0.0:1788463275.878196:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.878396:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.878493:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703808 00000100:00100000:2.0:1788463275.878498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703808 00000100:00100000:2.0:1788463275.878521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788463275.878528:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:10357:x1875339485703808:12345-0@lo:502: 00000100:00100000:2.0:1788463275.878633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:10357:x1875339485703808:12345-0@lo:502: Request processed in 105us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.878640:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788463275.878730:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10357:1875339485703808:0@lo:502: 00000020:01000000:0.0:1788463275.878755:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463275.878763:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463275.878766:0:10357:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463275.878770:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788463275.878791:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10357:1875339485703936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.878822:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.878848:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.878893:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485703936 00000100:00100000:2.0:1788463275.878897:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485703936 00000100:00100000:2.0:1788463275.878912:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788463275.878918:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:10357:x1875339485703936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.879253:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:10357:x1875339485703936:12345-0@lo:502:llog_process_th.0 Request processed in 333us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.879260:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788463275.879337:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10357:1875339485703936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463275.879371:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463275.879376:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463275.879378:0:10357:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788463275.879381:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788463275.879540:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788463275.879559:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788463275.879569:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.879684:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463275.879694:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788463275.879697:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188f7d1000 from 48 10000000:01000000:2.0:1788463275.879699:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463275.879725:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.879734:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.879743:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.879758:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.879786:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.879838:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.879905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704064 00000100:00100000:1.0:1788463275.879911:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704064 00000100:00100000:3.0:1788463275.880260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788463275.880271:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+17:6520:x1875339485704064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463275.880281:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463275.880293:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00ea00/0x841acb7f42a39773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3976c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463275.880315:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00ea00/0x841acb7f42a39773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3976c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463275.880326:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00ea00/0x841acb7f42a39773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3976c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463275.880359:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00ea00, rc 0) 00000100:00100000:3.0:1788463275.880391:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463275.880397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788463275.880461:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.880473:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.880482:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.880542:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.880564:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.880727:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.880776:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704192 00000100:00100000:0.0:1788463275.880781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704192 00000100:00100000:0.0:1788463275.880805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788463275.880810:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.880930:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.880937:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788463275.881116:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.881145:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.881183:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.881203:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.881242:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704320 00000100:00100000:0.0:1788463275.881246:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704320 00000100:00100000:0.0:1788463275.881261:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788463275.881266:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.881341:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.881358:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788463275.881421:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.881733:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10358:1875339485704448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.881763:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.881789:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.881829:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704448 00000100:00100000:0.0:1788463275.881833:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704448 00000100:00100000:0.0:1788463275.881852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788463275.881857:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:10358:x1875339485704448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.881943:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:10358:x1875339485704448:12345-0@lo:502:llog_process_th.0 Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.881957:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788463275.882149:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10358:1875339485704448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.882190:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10358:1875339485704576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.882221:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.882244:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.882288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704576 00000100:00100000:0.0:1788463275.882292:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704576 00000100:00100000:0.0:1788463275.882316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788463275.882322:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:10358:x1875339485704576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.882405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:10358:x1875339485704576:12345-0@lo:502:llog_process_th.0 Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.882411:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788463275.882479:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10358:1875339485704576:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788463275.882507:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788463275.882738:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788463275.882762:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463275.882773:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.882784:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463275.882793:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788463275.882797:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788463275.882800:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463275.882827:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.882835:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.882844:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.882857:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.882886:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.882911:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.883088:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704704 00000100:00100000:2.0:1788463275.883093:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704704 00000100:00100000:2.0:1788463275.883115:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788463275.883122:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+18:6520:x1875339485704704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.883131:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463275.883150:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21400/0x841acb7f42a39781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3977a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.883171:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21400/0x841acb7f42a39781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3977a expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.883182:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21400/0x841acb7f42a39781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3977a expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.883190:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21400, rc 0) 00000100:00100000:2.0:1788463275.883318:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485704704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.883324:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788463275.883474:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463275.883493:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.883502:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.883547:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.883694:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.883753:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.883782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704832 00000100:00100000:1.0:1788463275.883788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704832 00000100:00100000:1.0:1788463275.883848:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788463275.883857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485704832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.884109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485704832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.884116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788463275.884174:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.884202:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.884241:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.884310:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.884379:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485704960 00000100:00100000:2.0:1788463275.884384:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485704960 00000100:00100000:2.0:1788463275.884409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788463275.884415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485704960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.884504:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485704960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.884510:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788463275.884604:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485704960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.884932:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10359:1875339485705088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.884983:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.885003:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.885104:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705088 00000100:00100000:2.0:1788463275.885109:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705088 00000100:00100000:2.0:1788463275.885130:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788463275.885137:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:10359:x1875339485705088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.885218:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:10359:x1875339485705088:12345-0@lo:502:llog_process_th.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.885225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788463275.885372:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10359:1875339485705088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463275.885394:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463275.885402:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463275.885405:0:10359:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463275.885410:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788463275.885430:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10359:1875339485705216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.885461:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.885484:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.885529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705216 00000100:00100000:2.0:1788463275.885537:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705216 00000100:00100000:2.0:1788463275.885556:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788463275.885562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:10359:x1875339485705216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.885652:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:10359:x1875339485705216:12345-0@lo:502:llog_process_th.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.885659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788463275.885733:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10359:1875339485705216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463275.885752:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463275.885756:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463275.885758:0:10359:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788463275.885761:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788463275.885892:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788463275.885913:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788463275.885922:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.885932:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463275.885941:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788463275.885944:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188d0ea000 from 48 10000000:01000000:2.0:1788463275.885946:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463275.886097:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.886106:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.886115:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.886130:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.886158:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.886182:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.886230:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705344 00000100:00100000:0.0:1788463275.886234:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705344 00000100:00100000:0.0:1788463275.886255:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788463275.886261:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:6520:x1875339485705344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463275.886269:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463275.886281:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3978f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39788 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.886301:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39788 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.886311:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39788 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.886319:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5400, rc 0) 00000100:00100000:0.0:1788463275.886399:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.886404:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788463275.886755:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.886768:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.886778:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.886830:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.886856:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.886913:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.886940:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705472 00000100:00100000:0.0:1788463275.886945:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705472 00000100:00100000:0.0:1788463275.887150:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788463275.887158:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.887292:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.887313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788463275.887379:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.887408:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.887443:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.887509:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.887565:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705600 00000100:00100000:1.0:1788463275.887570:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705600 00000100:00100000:1.0:1788463275.887620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788463275.887628:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.887704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.887710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788463275.887794:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.888254:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10360:1875339485705728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.888295:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.888325:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.888374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705728 00000100:00100000:1.0:1788463275.888384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705728 00000100:00100000:1.0:1788463275.888405:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788463275.888412:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:10360:x1875339485705728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.888504:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:10360:x1875339485705728:12345-0@lo:502:llog_process_th.0 Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.888511:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788463275.888606:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10360:1875339485705728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.888644:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10360:1875339485705856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.888675:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.888686:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7ce9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.888734:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705856 00000100:00100000:1.0:1788463275.888738:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705856 00000100:00100000:1.0:1788463275.888755:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788463275.888761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:10360:x1875339485705856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.888829:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:10360:x1875339485705856:12345-0@lo:502:llog_process_th.0 Request processed in 67us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.888836:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788463275.888904:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10360:1875339485705856:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788463275.888922:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788463275.889177:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788463275.889197:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463275.889206:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.889216:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463275.889225:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788463275.889228:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788463275.889231:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788463275.889258:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.889266:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.889281:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463275.889296:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.889328:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.889370:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.889477:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485705984 00000100:00100000:2.0:1788463275.889482:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485705984 00000100:00100000:2.0:1788463275.889504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788463275.889510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485705984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.889519:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463275.889532:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20c00/0x841acb7f42a3979d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39796 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.889555:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20c00/0x841acb7f42a3979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39796 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.889565:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20c00/0x841acb7f42a3979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39796 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.889602:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20c00, rc 0) 00000100:00100000:2.0:1788463275.889631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485705984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.889637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788463275.889703:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485705984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463275.889715:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.889725:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463275.889770:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.889795:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.889820:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.889862:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706112 00000100:00100000:2.0:1788463275.889866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706112 00000100:00100000:2.0:1788463275.889885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788463275.889891:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485706112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.890116:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485706112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.890123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788463275.890185:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.890211:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.890246:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.890266:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.890308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706240 00000100:00100000:2.0:1788463275.890312:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706240 00000100:00100000:2.0:1788463275.890329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788463275.890335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485706240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.890433:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485706240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.890440:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788463275.890512:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.891221:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10361:1875339485706368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.891259:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.891315:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.891363:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706368 00000100:00100000:2.0:1788463275.891368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706368 00000100:00100000:2.0:1788463275.891439:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788463275.891448:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10361:x1875339485706368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.891541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10361:x1875339485706368:12345-0@lo:502:llog_process_th.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.891549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788463275.891648:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10361:1875339485706368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463275.891673:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463275.891681:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463275.891683:0:10361:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788463275.891687:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788463275.891706:0:10361:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10361:1875339485706496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.891737:0:10361:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.891868:0:10361:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.891921:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706496 00000100:00100000:0.0:1788463275.891927:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706496 00000100:00100000:0.0:1788463275.891960:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788463275.892109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10361:x1875339485706496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.892197:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10361:x1875339485706496:12345-0@lo:502:llog_process_th.0 Request processed in 91us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.892204:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788463275.892276:0:10361:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10361:1875339485706496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463275.892297:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463275.892301:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463275.892303:0:10361:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463275.892306:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788463275.892465:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788463275.892484:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788463275.892493:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.892503:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463275.892514:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463275.892517:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9618850d0800 from 48 10000000:01000000:0.0:1788463275.892520:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463275.892545:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.892552:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.892561:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.892602:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.892638:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.892657:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.892699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706624 00000100:00100000:2.0:1788463275.892703:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706624 00000100:00100000:2.0:1788463275.892729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788463275.892737:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485706624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.892746:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463275.892758:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21800/0x841acb7f42a397ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a397a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.892780:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21800/0x841acb7f42a397ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a397a4 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.892790:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21800/0x841acb7f42a397ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397a4 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.892799:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21800, rc 0) 00000100:00100000:2.0:1788463275.892870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485706624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.892888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788463275.893226:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463275.893240:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.893249:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463275.893301:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.893329:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.893401:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.893433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706752 00000100:00100000:2.0:1788463275.893438:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706752 00000100:00100000:2.0:1788463275.893505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788463275.893514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485706752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.893659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485706752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.893666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788463275.893789:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.893817:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.893854:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.894209:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.894261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485706880 00000100:00100000:1.0:1788463275.894267:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485706880 00000100:00100000:1.0:1788463275.894293:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788463275.894300:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485706880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.894405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485706880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.894412:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788463275.894483:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485706880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.894907:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10362:1875339485707008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.894949:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.895108:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.895149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707008 00000100:00100000:1.0:1788463275.895155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707008 00000100:00100000:1.0:1788463275.895183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788463275.895191:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10362:x1875339485707008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.895278:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10362:x1875339485707008:12345-0@lo:502:llog_process_th.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.895285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788463275.895784:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10362:1875339485707008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.895830:0:10362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10362:1875339485707136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.895865:0:10362:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.895890:0:10362:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463275.895937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707136 00000100:00100000:2.0:1788463275.895941:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707136 00000100:00100000:2.0:1788463275.896099:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788463275.896108:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10362:x1875339485707136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463275.896202:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10362:x1875339485707136:12345-0@lo:502:llog_process_th.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.896209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788463275.896277:0:10362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10362:1875339485707136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788463275.896297:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788463275.896449:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788463275.896468:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463275.896476:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.896487:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463275.896497:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788463275.896500:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788463275.896502:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788463275.896526:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.896541:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.896551:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.896566:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.896622:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.896643:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.896694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707264 00000100:00100000:0.0:1788463275.896698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707264 00000100:00100000:0.0:1788463275.896719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788463275.896725:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485707264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463275.896734:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463275.896746:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4800/0x841acb7f42a397b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a397b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.896767:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4800/0x841acb7f42a397b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a397b2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.896776:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4800/0x841acb7f42a397b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397b2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.896785:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4800, rc 0) 00000100:00100000:0.0:1788463275.896823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.896828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788463275.896933:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463275.896946:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463275.897088:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.897141:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.897167:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.897189:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.897228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707392 00000100:00100000:0.0:1788463275.897232:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707392 00000100:00100000:0.0:1788463275.897259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788463275.897266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.897387:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.897394:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788463275.897479:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.897505:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463275.897540:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463275.897561:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.897662:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707520 00000100:00100000:0.0:1788463275.897672:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707520 00000100:00100000:0.0:1788463275.897735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788463275.897742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463275.897825:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.897831:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788463275.897891:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463275.899185:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10363:1875339485707648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463275.899246:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463275.899282:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.899326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707648 00000100:00100000:1.0:1788463275.899333:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707648 00000100:00100000:1.0:1788463275.899387:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788463275.899395:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10363:x1875339485707648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463275.899509:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10363:x1875339485707648:12345-0@lo:502:llog_process_th.0 Request processed in 114us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.899516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788463275.899657:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10363:1875339485707648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463275.899689:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463275.899697:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463275.899699:0:10363:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463275.899705:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788463275.899724:0:10363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10363:1875339485707776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463275.899757:0:10363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463275.899787:0:10363:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.899827:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707776 00000100:00100000:0.0:1788463275.899831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707776 00000100:00100000:0.0:1788463275.899858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788463275.899866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10363:x1875339485707776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463275.899943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10363:x1875339485707776:12345-0@lo:502:llog_process_th.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.899960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788463275.900178:0:10363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10363:1875339485707776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463275.900199:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463275.900204:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463275.900205:0:10363:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463275.900209:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788463275.900367:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788463275.900396:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788463275.900406:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.900416:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463275.900427:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788463275.900430:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff961884ff19c0 from 1 10000000:01000000:1.0:1788463275.900433:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463275.900459:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.900467:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463275.900476:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463275.900492:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.900525:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463275.900553:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617870950c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463275.900628:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485707904 00000100:00100000:0.0:1788463275.900633:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485707904 00000100:00100000:0.0:1788463275.900663:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788463275.900671:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485707904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463275.900680:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463275.900692:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a397c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a397c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.900713:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a397c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a397c0 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.900724:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a397c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397c0 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463275.900732:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5e00, rc 0) 00000100:00100000:0.0:1788463275.900778:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485707904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.900784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788463275.900862:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485707904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463275.900876:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463275.900885:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463275.900942:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485708032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463275.901109:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463275.901139:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463275.901189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708032 00000100:00100000:1.0:1788463275.901193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708032 00000100:00100000:1.0:1788463275.901226:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788463275.901233:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485708032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463275.901299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485708032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (190us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463275.901306:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788463275.901400:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485708032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788463275.901427:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788463275.901433:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463275.901441:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463275.910717:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463275.910752:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485708160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463275.910829:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.910974:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708160 00000100:00100000:0.0:1788463275.910983:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708160 00000100:00100000:0.0:1788463275.911055:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463275.911064:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485708160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463275.911093:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463275.911143:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485708160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.911149:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788463275.911309:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6680 x1875339485708160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463275.911330:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485708160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463275.911397:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463276.420014:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485708288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463276.420089:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463276.420228:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708288 00000100:00100000:2.0:1788463276.420236:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708288 00000100:00100000:2.0:1788463276.420310:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463276.420323:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485708288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463276.420356:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463276.420405:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485708288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463276.420412:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788463276.420454:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6680 x1875339485708288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463276.420480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485708288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463276.420607:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463276.675986:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463277.443893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463277.443919:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485708416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463277.443993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463277.444151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463277.444161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463277.444191:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463277.444227:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708416 00000100:00100000:2.0:1788463277.444234:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708416 00000100:00100000:2.0:1788463277.444282:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708544 00000100:00100000:2.0:1788463277.444285:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708544 00000100:00100000:2.0:1788463277.444305:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463277.444314:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485708416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463277.444355:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463277.444419:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485708416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463277.444426:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463277.444445:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463277.444452:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485708544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463277.444463:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463277.444492:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485708544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463277.444498:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788463277.444514:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788463277.444541:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5180 x1875339485708544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463277.444559:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485708544:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788463277.444609:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6680 x1875339485708416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463277.444620:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485708416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463277.445704:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485708672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.445760:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.445808:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.445837:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.445862:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463277.445868:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.445892:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.445922:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709184 00000100:00100000:3.0:1788463277.445929:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709184 00000100:00100000:3.0:1788463277.445973:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463277.445982:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485709184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446030:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485709184:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463277.446051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463277.446077:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709056 00000100:00100000:3.0:1788463277.446080:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709056 00000100:00100000:3.0:1788463277.446111:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463277.446132:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446166:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485709056:12345-0@lo:400:kworker.0 Request processed in 49us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463277.446172:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463277.446207:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446218:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446259:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485708800:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.446301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485709312:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446333:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.446351:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463277.446356:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485708928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446377:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.446396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485709440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463277.446443:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708928 00000100:00100000:3.0:1788463277.446446:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708928 00000100:00100000:3.0:1788463277.446469:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463277.446475:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.446509:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485708928:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463277.446521:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463277.446537:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708800 00000100:00100000:3.0:1788463277.446540:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708800 00000100:00100000:3.0:1788463277.446554:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709312 00000100:00100000:3.0:1788463277.446556:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709312 00000100:00100000:3.0:1788463277.446571:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709440 00000100:00100000:3.0:1788463277.446605:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709440 00000100:00100000:1.0:1788463277.446931:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485709696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.446960:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463277.446977:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463277.446982:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485709568:0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.446998:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463277.447018:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709696 00000100:00100000:1.0:1788463277.447021:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709696 00000100:00100000:1.0:1788463277.447041:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709568 00000100:00100000:1.0:1788463277.447043:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709568 00000100:00100000:1.0:1788463277.447060:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463277.447065:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485709696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.447095:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485709696:12345-0@lo:400:kworker.0 Request processed in 29us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463277.447107:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463277.447213:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463277.447224:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485709568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463277.447253:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485709568:12345-0@lo:400:kworker.0 Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463277.447258:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788463277.447306:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa19180 x1875339485709568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463277.447328:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485709568:0@lo:400:kworker.0 00010000:00080000:1.0:1788463277.447346:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa18380 x1875339485709696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463277.447355:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485709696:0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.447407:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463277.447417:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485708800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463277.447445:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485708800:12345-0@lo:400:kworker.0 Request processed in 31us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463277.447503:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485709952:0@lo:400:kworker.0 00000100:00100000:0.0:1788463277.447533:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463277.447547:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463277.447552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485709824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463277.447566:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463277.447596:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709952 00000100:00100000:0.0:1788463277.447599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709952 00000100:00080000:2.0:1788463277.450496:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463277.450513:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463277.450515:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463277.450602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485709824 00000100:00100000:2.0:1788463277.450638:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485709824 00000100:00100000:1.0:1788463277.450744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788463277.450759:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.450862:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485709312:12345-0@lo:400:kworker.0 Request processed in 108us (4528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463277.450871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788463277.450892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788463277.450900:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485709440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.450930:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485709440:12345-0@lo:400:kworker.0 Request processed in 32us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463277.450935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788463277.450982:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485708928:0@lo:400:kworker.0 00010000:00080000:1.0:1788463277.450998:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727ca80 x1875339485709440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463277.451009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.451022:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485708800:0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.451043:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.451078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485708672 00000100:00100000:1.0:1788463277.451083:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485708672 00000100:00100000:1.0:1788463277.451129:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788463277.451136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463277.451177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485708672:12345-0@lo:400:kworker.0 Request processed in 42us (5417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463277.451183:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788463277.451211:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485708672:0@lo:400:kworker.0 00000100:00080000:1.0:1788463277.451261:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463277.452007:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463277.452263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463277.452277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485709952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463277.452361:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485709952:12345-0@lo:400:kworker.0 Request processed in 90us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463277.452367:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788463277.452487:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1b480 x1875339485709952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463277.452499:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485709952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463277.452713:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463277.452726:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485709824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463277.452808:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485709824:12345-0@lo:400:kworker.0 Request processed in 87us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463277.452814:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463277.452882:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485709824:0@lo:400:kworker.0 00010000:00010000:0.0:1788463277.699745:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463277.957930:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463277.957965:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485710080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463277.958185:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463277.958480:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710080 00000100:00100000:2.0:1788463277.958490:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710080 00000100:00100000:2.0:1788463277.958547:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463277.958568:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485710080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463277.958630:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463277.958691:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485710080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463277.958699:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463277.959507:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485710080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463278.469466:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463278.469507:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485710208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463278.469629:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463278.471855:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710208 00000100:00100000:1.0:1788463278.471869:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710208 00000100:00100000:1.0:1788463278.471947:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463278.471959:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485710208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463278.471997:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463278.472094:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485710208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463278.472101:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463278.473524:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485710208:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463278.723978:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463278.828560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463278.830936:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466773888 00000100:00100000:3.0:1788463278.830953:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466773888 00000100:00100000:3.0:1788463278.831164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:3.0:1788463278.831175:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:6174:x1875339466773888:12345-192.168.204.53@tcp:101: 00010000:00010000:3.0:1788463278.831204:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463278.831235:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00f400/0x841acb7f42a397ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.831263:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00f400/0x841acb7f42a397ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765ee expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.831274:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00f400/0x841acb7f42a397ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765ee expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.831284:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f400, rc 0) 00000100:00100000:3.0:1788463278.831412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466773888:12345-192.168.204.53@tcp:101: Request processed in 238us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463278.831420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:0.0:1788463278.847083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463278.849067:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774016 00000100:00100000:1.0:1788463278.849081:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774016 00000100:00100000:1.0:1788463278.849270:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:1.0:1788463278.849283:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466774016:12345-192.168.204.53@tcp:501: 00000100:00100000:1.0:1788463278.849477:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466774016:12345-192.168.204.53@tcp:501: Request processed in 196us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463278.849500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:0.0:1788463278.855222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463278.855420:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774144 00000100:00100000:3.0:1788463278.855431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774144 00000100:00100000:3.0:1788463278.855486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 247 00000100:00100000:3.0:1788463278.855495:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466774144:12345-192.168.204.53@tcp:503: 00000100:00100000:3.0:1788463278.855745:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466774144:12345-192.168.204.53@tcp:503: Request processed in 249us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463278.855753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 247 00000100:00100000:3.0:1788463278.876814:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463278.877884:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774272 00000100:00100000:1.0:1788463278.877898:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774272 00000100:00100000:1.0:1788463278.877979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 248 00000100:00100000:1.0:1788463278.877990:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6668:x1875339466774272:12345-192.168.204.53@tcp:502: 00000100:00100000:1.0:1788463278.878154:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6668:x1875339466774272:12345-192.168.204.53@tcp:502: Request processed in 165us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463278.878163:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 248 00000100:00100000:0.0:1788463278.888870:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463278.889193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774400 00000100:00100000:2.0:1788463278.889204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774400 00000100:00100000:2.0:1788463278.889271:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 249 00000100:00100000:2.0:1788463278.889283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6668:x1875339466774400:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463278.889470:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6668:x1875339466774400:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 188us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463278.889478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 249 00000100:00100000:0.0:1788463278.899146:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463278.899409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774528 00000100:00100000:3.0:1788463278.899420:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774528 00000100:00100000:3.0:1788463278.899706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 250 00000100:00100000:3.0:1788463278.899718:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466774528:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463278.899747:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463278.899766:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618be00fe00/0x841acb7f42a397d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.899817:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618be00fe00/0x841acb7f42a397d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765f5 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.899830:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618be00fe00/0x841acb7f42a397d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765f5 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463278.899839:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00fe00, rc 0) 00000100:00100000:3.0:1788463278.899909:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466774528:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 193us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463278.899917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 250 00000100:00100000:3.0:1788463278.905239:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463278.905911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774656 00000100:00100000:1.0:1788463278.905923:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774656 00000100:00100000:1.0:1788463278.905994:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 251 00000100:00100000:1.0:1788463278.906006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466774656:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463278.906134:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466774656:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 130us (911us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463278.906142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 251 00010000:00010000:3.0:1788463279.747934:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463279.855248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463279.855298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463279.855334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463279.855381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463279.855400:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775040 00000100:00100000:2.0:1788463279.855413:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775040 00000100:00100000:2.0:1788463279.855481:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775168 00000100:00100000:2.0:1788463279.855490:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775168 00000100:00100000:2.0:1788463279.855517:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:2.0:1788463279.855530:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466775040:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:3.0:1788463279.856081:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463279.856086:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463279.856706:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:3.0:1788463279.856724:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466775168:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463279.856781:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466775168:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 64us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463279.856789:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463279.857261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774784 00000100:00100000:1.0:1788463279.857282:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774784 00000100:00100000:1.0:1788463279.857396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466774912 00000100:00100000:1.0:1788463279.857401:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466774912 00000100:00080000:3.0:1788463279.857428:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463279.857432:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463279.857467:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466775040:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1938us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463279.857478:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:1.0:1788463279.857802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:1.0:1788463279.857811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466774784:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463279.857868:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466774784:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 58us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463279.857875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:1.0:1788463279.857892:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:1.0:1788463279.857907:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466774912:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463279.857936:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466774912:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463279.857942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000020:00000080:2.0:1788463280.102961:0:10401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee19cd040 20000000:00000080:2.0:1788463280.102981:0:10401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96188fba4800 uarg=0000000000000000 20000000:01000000:2.0:1788463280.103024:0:10401:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788463280.103030:0:10401:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788463280.103035:0:10401:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788463280.103536:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788463280.103873:0:10401:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788463280.108432:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788463280.111759:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788463280.111809:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788463280.111833:0:10401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463280.111855:0:10401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111874:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39471 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111882:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111889:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111896:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111917:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111925:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111967:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.111981:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 9 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.111995:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710336:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463280.112259:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.112282:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 23 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112293:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710464:0@lo:104: 00000100:00100000:2.0:1788463280.112342:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463280.112383:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.112391:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112398:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710592:0@lo:104: 00000100:00100000:2.0:1788463280.112432:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463280.112468:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.112477:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112485:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710720:0@lo:104: 00000100:00100000:1.0:1788463280.112487:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788463280.112499:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710464 00000100:00100000:1.0:1788463280.112506:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710464 00000100:00100000:1.0:1788463280.112543:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710592 00000100:00100000:1.0:1788463280.112547:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710592 00000100:00100000:1.0:1788463280.112561:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788463280.112570:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10401:x1875339485710464:12345-0@lo:104: 00000100:00100000:2.0:1788463280.112591:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463280.112603:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.112666:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463280.112672:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10401:x1875339485710464:12345-0@lo:104: Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.112680:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788463280.112695:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710720 00000100:00100000:1.0:1788463280.112698:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710720 00000100:00100000:1.0:1788463280.112711:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463280.112717:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10401:x1875339485710592:12345-0@lo:104: 00010000:00010000:1.0:1788463280.112725:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.112758:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463280.112762:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787cf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:10401:x1875339485710592:12345-0@lo:104: Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.112777:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463280.112810:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463280.112817:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10401:x1875339485710720:12345-0@lo:104: 00010000:00010000:1.0:1788463280.112825:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.112841:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463280.112849:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 23 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.112857:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788463280.112858:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710848:0@lo:104: 00000100:00100000:1.0:1788463280.112861:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10401:x1875339485710720:12345-0@lo:104: Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.112867:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463280.112880:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463280.112883:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463280.112888:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112895:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96900 going to sleep for 11 seconds 00010000:00010000:1.0:1788463280.112895:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207e600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463280.112899:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112915:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710464:0@lo:104: 00010000:00010000:1.0:1788463280.112921:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.112923:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710592:0@lo:104: 00000100:00100000:2.0:1788463280.112930:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710720:0@lo:104: 10000000:00010000:1.0:1788463280.112930:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463280.112936:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463280.112966:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.112972:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463280.113005:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113013:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207e600/0x841acb7f42a395f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39600 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113026:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463280.113029:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113035:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463280.113038:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113044:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463280.113050:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463280.113055:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463280.113071:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113076:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463280.113082:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113089:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813200/0x841acb7f42a394d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a394da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463280.113097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485710976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463280.113098:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463280.113106:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113112:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207f000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463280.113115:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113122:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463280.113128:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463280.113133:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463280.113147:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113153:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463280.113177:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113184:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207f000/0x841acb7f42a3947f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39486 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113193:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.113195:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.113196:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.113203:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.113207:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463280.113217:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485711104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463280.113248:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485711232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463280.113464:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710848 00000100:00100000:3.0:1788463280.113476:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710848 00000100:00100000:3.0:1788463280.113500:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463280.113507:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10401:x1875339485710848:12345-0@lo:104: 00010000:00010000:3.0:1788463280.113516:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463280.113796:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463280.113846:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711104 00000100:00100000:1.0:1788463280.113851:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711104 00010000:00010000:1.0:1788463280.113870:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 24 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463280.113893:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463280.113899:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485711104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463280.113921:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463280.113928:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 24 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113937:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 24 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113952:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00f600/0x841acb7f42a394da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a394d3 expref: 24 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.113965:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463280.113984:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463280.113990:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3649:x1875339485711104:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.113996:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463280.114008:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711232 00000100:00100000:1.0:1788463280.114011:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711232 00010000:00010000:1.0:1788463280.114022:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463280.114046:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463280.114052:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3650:x1875339485711232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463280.114075:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463280.114080:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.114092:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.114102:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00e800/0x841acb7f42a39486 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3947f expref: 23 pid: 6516 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.114113:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463280.114143:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3650:x1875339485711232:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.114148:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463280.114193:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485711232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463280.114219:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485711104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463280.115789:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463280.115943:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463280.115950:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:10401:x1875339485710848:12345-0@lo:104: Request processed in 2444us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463280.115960:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463280.116051:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710848:0@lo:104: 00000100:00100000:0.0:1788463280.116087:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485710976 00000100:00100000:0.0:1788463280.116094:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485710976 00010000:00010000:0.0:1788463280.116233:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 22 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463280.116306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463280.116315:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3648:x1875339485710976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463280.116327:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463280.116332:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 22 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.116342:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 22 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.116357:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5800/0x841acb7f42a39600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a395f9 expref: 22 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.116369:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463280.116452:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3648:x1875339485710976:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463280.116458:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788463280.116515:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463280.116522:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116529:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463280.116534:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116542:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463280.116548:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463280.116554:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463280.116628:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116636:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463280.116661:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116668:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a39471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39478 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116684:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.116686:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463280.116688:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463280.116694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463280.116706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485711360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463280.116745:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463280.116774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485710976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463280.116778:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711360 00000100:00100000:1.0:1788463280.116781:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711360 00010000:00010000:1.0:1788463280.116795:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 21 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463280.116827:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463280.116834:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3650:x1875339485711360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463280.116842:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463280.116847:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 21 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116855:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 21 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116865:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39471 expref: 21 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.116881:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463280.116917:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3650:x1875339485711360:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.116923:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788463280.116934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485711360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463280.121202:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1875339485710336:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463280.121254:0:10401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463280.122056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463280.123188:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775296 00000100:00100000:0.0:1788463280.123201:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775296 00010000:00010000:0.0:1788463280.123245:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463280.123290:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:0.0:1788463280.123301:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466775296:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463280.123317:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463280.123324:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123336:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123355:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21c00/0x841acb7f42a39718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765b6 expref: 10 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123372:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123380:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123397:0:9527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123419:0:9527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123426:0:9527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123433:0:9527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123439:0:9527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463280.123444:0:9527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.123452:0:9527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.123830:0:10401:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463280.123839:0:10401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.125354:0:9527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.125370:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21a00/0x841acb7f42a397dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.125390:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463280.125771:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:2400:x1875339466775296:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 2465us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463280.125782:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:3.0:1788463280.236664:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463280.236757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775424 00000100:00100000:0.0:1788463280.236768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775424 00000100:00100000:0.0:1788463280.236818:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 252 00000100:00100000:0.0:1788463280.236830:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:6174:x1875339466775424:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463280.236857:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463280.236878:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4765fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.236909:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.236921:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463280.236931:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5800, rc 0) 00000100:00100000:0.0:1788463280.237081:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466775424:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 252us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463280.237088:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 252 00000100:00100000:0.0:1788463280.244599:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463280.244666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775552 00000100:00100000:2.0:1788463280.244675:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775552 00000100:00100000:2.0:1788463280.244739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 253 00000100:00100000:2.0:1788463280.244751:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466775552:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463280.244920:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466775552:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 170us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463280.244929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 253 00000100:00100000:0.0:1788463280.263991:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463280.267857:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775680 00000100:00100000:1.0:1788463280.267872:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775680 00000100:00100000:1.0:1788463280.267930:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:1.0:1788463280.267941:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466775680:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463280.268105:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6174:x1875339466775680:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 165us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463280.268188:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:3.0:1788463280.288408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463280.288642:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775808 00000100:00100000:3.0:1788463280.288652:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775808 00000100:00100000:3.0:1788463280.288704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00100000:3.0:1788463280.288716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6699:x1875339466775808:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463280.288871:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6699:x1875339466775808:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 156us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463280.288880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00100000:1.0:1788463280.306312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463280.309427:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466775936 00000100:00100000:2.0:1788463280.309443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466775936 00000100:00100000:2.0:1788463280.309515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 256 00000100:00100000:2.0:1788463280.309527:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6699:x1875339466775936:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463280.310091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:6699:x1875339466775936:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 565us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463280.310101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 256 00010000:00010000:0.0:1788463280.774074:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463281.029833:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463281.029857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485711488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463281.029928:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463281.033791:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711488 00000100:00100000:2.0:1788463281.033807:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711488 00000100:00100000:2.0:1788463281.033880:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463281.033893:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485711488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463281.033926:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463281.034000:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485711488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463281.034007:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788463281.034028:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463281.036477:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e1a680 x1875339485711488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463281.036502:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485711488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463281.546188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485711616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463281.546273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463281.546346:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711616 00000100:00100000:2.0:1788463281.546354:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711616 00000100:00100000:2.0:1788463281.546409:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463281.546417:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485711616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463281.546438:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463281.546478:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485711616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463281.546500:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788463281.546520:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463281.546571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5c00 x1875339485711616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463281.546617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485711616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463281.795885:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463282.051708:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463282.051716:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f993000 from 4 10000000:01000000:2.0:1788463282.051722:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463282.051788:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.051800:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.051812:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.051839:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485711744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.051920:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.051985:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.052140:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711744 00000100:00100000:3.0:1788463282.052149:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711744 00000100:00100000:3.0:1788463282.052214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788463282.052224:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485711744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463282.052247:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463282.052260:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a397ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.052286:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a397ea expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.052296:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397ea expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.052306:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030c00, rc 0) 00000100:00100000:3.0:1788463282.052342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485711744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.052349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788463282.052612:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485711744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463282.052627:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.052637:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.052699:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.052740:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.052766:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.052872:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485711872 00000100:00100000:3.0:1788463282.052877:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485711872 00000100:00100000:3.0:1788463282.052898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788463282.052905:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485711872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.053036:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485711872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.053043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788463282.053071:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485711872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.053105:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.053140:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.053157:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.055060:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712000 00000100:00100000:2.0:1788463282.055074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712000 00000100:00100000:2.0:1788463282.055130:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788463282.055140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485712000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.055303:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485712000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.055311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788463282.055687:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.055905:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10473:1875339485712128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463282.055965:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.055991:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.056645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712128 00000100:00100000:2.0:1788463282.056653:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712128 00000100:00100000:2.0:1788463282.056696:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788463282.056706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10473:x1875339485712128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.056824:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10473:x1875339485712128:12345-0@lo:502:llog_process_th.0 Request processed in 118us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.056832:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788463282.057938:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10473:1875339485712128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463282.057984:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463282.057995:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463282.057997:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788463282.058005:0:10473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188f993000 00000020:00000080:3.0:1788463282.058008:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788463282.058092:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10473:1875339485712256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463282.058141:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.058167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712256 00000100:00100000:3.0:1788463282.058173:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712256 00000100:00100000:3.0:1788463282.058205:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788463282.058212:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10473:x1875339485712256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463282.058307:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:10473:x1875339485712256:12345-0@lo:502:llog_process_th.0 Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.058315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788463282.058357:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.058369:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10473:1875339485712256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463282.058385:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463282.058394:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463282.058396:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788463282.058400:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788463282.058462:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788463282.058487:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463282.058498:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058509:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463282.058520:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463282.058523:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f7d1000 from 4 10000000:01000000:3.0:1788463282.058525:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463282.058560:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058569:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058601:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463282.058614:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.058641:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.058659:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.058669:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712384 00000100:00100000:3.0:1788463282.058672:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712384 00000100:00100000:3.0:1788463282.058694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788463282.058700:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485712384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463282.058708:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463282.058726:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a397f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058748:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058769:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058779:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880030e00, rc 0) 00000100:00100000:3.0:1788463282.058807:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485712384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.058813:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788463282.058843:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463282.058854:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463282.058863:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463282.058905:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.058926:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.058938:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.058947:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712512 00000100:00100000:3.0:1788463282.058950:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712512 00000100:00100000:3.0:1788463282.058966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788463282.058972:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485712512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.059057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485712512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.059070:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788463282.059098:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.059121:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.059152:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463282.059165:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463282.059175:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712640 00000100:00100000:3.0:1788463282.059178:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712640 00000100:00100000:3.0:1788463282.059196:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788463282.059202:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485712640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463282.059279:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485712640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463282.059286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788463282.059325:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485712640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.065794:0:10474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10474:1875339485712768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.065872:0:10474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.065904:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712768 00000100:00100000:2.0:1788463282.065910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712768 00000100:00100000:2.0:1788463282.065949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788463282.065968:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10474:x1875339485712768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.066077:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10474:x1875339485712768:12345-0@lo:502:llog_process_th.0 Request processed in 109us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.066084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788463282.066134:0:10474:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.066157:0:10474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10474:1875339485712768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463282.066183:0:10474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463282.066192:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463282.066194:0:10474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463282.066201:0:10474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188f7d1000 00000020:00000080:2.0:1788463282.066203:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463282.066272:0:10474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10474:1875339485712896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.066300:0:10474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.066317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485712896 00000100:00100000:2.0:1788463282.066320:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485712896 00000100:00100000:2.0:1788463282.066338:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788463282.066344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10474:x1875339485712896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.066392:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:10474:x1875339485712896:12345-0@lo:502:llog_process_th.0 Request processed in 47us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.066399:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788463282.066421:0:10474:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.066430:0:10474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10474:1875339485712896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463282.066444:0:10474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463282.066448:0:10474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463282.066450:0:10474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788463282.066453:0:10474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788463282.066522:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788463282.066555:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463282.066565:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066596:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463282.066617:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463282.066620:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188d0ea000 from 4 10000000:01000000:2.0:1788463282.066623:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463282.066645:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066652:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066661:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.066672:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.066695:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.066705:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.066717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713024 00000100:00100000:2.0:1788463282.066720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713024 00000100:00100000:2.0:1788463282.066737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788463282.066742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485713024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463282.066750:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463282.066761:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39806 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066781:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39806 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066791:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39806 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066810:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:2.0:1788463282.066835:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.066841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788463282.066865:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463282.066875:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.066884:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.066918:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.066936:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.066945:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.066954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713152 00000100:00100000:2.0:1788463282.066956:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713152 00000100:00100000:2.0:1788463282.066971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788463282.066976:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.067046:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.067052:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788463282.067073:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.067092:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.067118:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.067133:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.067141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713280 00000100:00100000:2.0:1788463282.067144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713280 00000100:00100000:2.0:1788463282.067160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788463282.067165:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.067214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 48us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.067220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788463282.067262:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.067467:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10477:1875339485713408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.067493:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.067506:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713408 00000100:00100000:2.0:1788463282.067509:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713408 00000100:00100000:2.0:1788463282.067525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788463282.067530:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10477:x1875339485713408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.067601:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10477:x1875339485713408:12345-0@lo:502:llog_process_th.0 Request processed in 71us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.067607:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788463282.067630:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.067638:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10477:1875339485713408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463282.067654:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463282.067659:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463282.067661:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463282.067666:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188d0ea000 00000020:00000080:2.0:1788463282.067668:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463282.067708:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10477:1875339485713536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.067738:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.067753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713536 00000100:00100000:2.0:1788463282.067755:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713536 00000100:00100000:2.0:1788463282.067771:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788463282.067775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10477:x1875339485713536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.067826:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:10477:x1875339485713536:12345-0@lo:502:llog_process_th.0 Request processed in 49us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.067831:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788463282.067853:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.067862:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10477:1875339485713536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463282.067875:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463282.067878:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463282.067880:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788463282.067882:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788463282.067925:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788463282.067938:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463282.067944:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.067953:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463282.067962:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463282.067963:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618850d0800 from 4 10000000:01000000:2.0:1788463282.067966:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463282.067980:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.067987:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.067999:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.068011:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.068031:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.068040:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.068049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713664 00000100:00100000:2.0:1788463282.068052:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713664 00000100:00100000:2.0:1788463282.068067:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788463282.068072:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485713664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463282.068079:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463282.068086:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39814 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.068108:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39814 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.068117:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39814 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.068124:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:2.0:1788463282.068148:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485713664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.068154:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788463282.068178:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463282.068188:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463282.068201:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463282.068249:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.068277:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.068289:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.068299:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713792 00000100:00100000:2.0:1788463282.068301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713792 00000100:00100000:2.0:1788463282.068320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788463282.068326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485713792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.068396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485713792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.068403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788463282.068428:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.068450:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.080063:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.080119:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463282.080150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485713920 00000100:00100000:2.0:1788463282.080159:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485713920 00000100:00100000:2.0:1788463282.080210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788463282.080220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485713920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.080359:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485713920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.080367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788463282.080432:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485713920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463282.080668:0:10478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10478:1875339485714048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.080708:0:10478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463282.080728:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714048 00000100:00100000:2.0:1788463282.080731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714048 00000100:00100000:2.0:1788463282.080753:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788463282.083140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:10478:x1875339485714048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463282.083313:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:10478:x1875339485714048:12345-0@lo:502:llog_process_th.0 Request processed in 2552us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.083323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788463282.083669:0:10478:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f578240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463282.083698:0:10478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10478:1875339485714048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463282.083733:0:10478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463282.083743:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463282.083745:0:10478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788463282.083751:0:10478:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9618850d0800 00000020:00000080:1.0:1788463282.083753:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788463282.084982:0:10478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10478:1875339485714176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463282.085047:0:10478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463282.085067:0:10478:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463282.085097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714176 00000100:00100000:1.0:1788463282.085103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714176 00000100:00100000:1.0:1788463282.085139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788463282.085147:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:10478:x1875339485714176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463282.085249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:10478:x1875339485714176:12345-0@lo:502:llog_process_th.0 Request processed in 102us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463282.085257:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788463282.085296:0:10478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:10478:1875339485714176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463282.085315:0:10478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463282.085320:0:10478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463282.085322:0:10478:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788463282.085325:0:10478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788463282.085463:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788463282.085484:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463282.085494:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463282.085505:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463282.563869:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485714304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463282.563956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.566824:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463282.566846:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485714432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463282.566922:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.566990:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714304 00000100:00100000:0.0:1788463282.567016:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714304 00000100:00100000:0.0:1788463282.567073:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714432 00000100:00100000:0.0:1788463282.567076:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714432 00000100:00100000:0.0:1788463282.567097:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463282.567105:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485714304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463282.567139:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463282.567186:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485714304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.567193:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463282.567208:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463282.567214:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485714432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463282.567234:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463282.567258:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485714432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.567264:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788463282.567375:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463282.567387:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485714560:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567436:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485715072:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485715584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567524:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788463282.567529:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485714688:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485715200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567699:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567728:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.567778:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715072 00000100:00100000:0.0:1788463282.567783:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715072 00000100:00100000:0.0:1788463282.567808:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463282.567814:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485715072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567849:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485715072:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.567856:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463282.567873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714688 00000100:00100000:0.0:1788463282.567876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714688 00000100:00100000:0.0:1788463282.567896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715200 00000100:00100000:0.0:1788463282.567899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715200 00000100:00100000:0.0:1788463282.567914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715712 00000100:00100000:0.0:1788463282.567917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715712 00000100:00100000:0.0:1788463282.567930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463282.567936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485714688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.567963:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485714688:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.567969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463282.567980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788463282.567985:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485715200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568006:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485715200:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.568012:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788463282.568021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463282.568027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485715712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568062:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485715712:12345-0@lo:400:kworker.0 Request processed in 35us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.568069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788463282.568093:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463282.568191:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485714688:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568202:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787852680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485715200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568210:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485715072:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568259:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485714816:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568283:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.568301:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485715328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568318:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.568332:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485715840:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788463282.568371:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e1a680 x1875339485714432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463282.568388:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485714432:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788463282.568400:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6a00 x1875339485714304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463282.568410:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485714304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463282.568426:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463282.568431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485714944:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.568476:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485715456:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.568509:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463282.568535:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714816 00000100:00100000:0.0:1788463282.568540:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714816 00000100:00100000:0.0:1788463282.568562:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463282.568568:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485714816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.568749:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714560 00000100:00100000:2.0:1788463282.568754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714560 00000100:00100000:2.0:1788463282.568787:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788463282.568794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485714560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.568830:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485714560:12345-0@lo:400:kworker.0 Request processed in 37us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.568837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788463282.568888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485714560:0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.570797:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485714816:12345-0@lo:400:kworker.0 Request processed in 2222us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.570810:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463282.570855:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715584 00000100:00100000:0.0:1788463282.570864:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715584 00000100:00100000:0.0:1788463282.570904:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715456 00000100:00100000:0.0:1788463282.570907:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715456 00000100:00100000:0.0:1788463282.570928:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463282.570936:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485715584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463282.571002:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485715584:12345-0@lo:400:kworker.0 Request processed in 65us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.571009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463282.571020:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463282.571026:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485715456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.572798:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715328 00000100:00100000:2.0:1788463282.572815:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715328 00000100:00100000:2.0:1788463282.572877:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715840 00000100:00100000:2.0:1788463282.572881:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715840 00000100:00100000:2.0:1788463282.572900:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485714944 00000100:00100000:2.0:1788463282.572903:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485714944 00000100:00100000:2.0:1788463282.572917:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463282.572925:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485715328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.573003:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485715328:12345-0@lo:400:kworker.0 Request processed in 79us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.573010:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463282.573025:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463282.573030:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485715840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.573053:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485715840:12345-0@lo:400:kworker.0 Request processed in 23us (4704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.573058:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463282.573067:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463282.573072:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485714944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.573093:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485714944:12345-0@lo:400:kworker.0 Request processed in 22us (4633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463282.573098:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463282.573149:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485714944:0@lo:400:kworker.0 00000100:00080000:3.0:1788463282.573182:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463282.573263:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485715456:12345-0@lo:400:kworker.0 Request processed in 2236us (4752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463282.573271:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788463282.573314:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787853800 x1875339485715584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463282.573337:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485715584:0@lo:400:kworker.0 00010000:00080000:2.0:1788463282.574800:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787850e00 x1875339485715456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463282.574816:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485715456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463282.574832:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485714816:0@lo:400:kworker.0 00010000:00080000:2.0:1788463282.574844:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787852300 x1875339485715328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463282.574851:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485715328:0@lo:400:kworker.0 00010000:00080000:2.0:1788463282.574863:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787851180 x1875339485715840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463282.574885:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485715840:0@lo:400:kworker.0 00010000:00010000:1.0:1788463282.819881:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463283.075988:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485715968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463283.076063:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463283.076254:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485715968 00000100:00100000:2.0:1788463283.076263:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485715968 00000100:00100000:2.0:1788463283.076317:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463283.076326:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485715968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463283.076360:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463283.076409:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485715968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463283.076416:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788463283.076591:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485715968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463283.588113:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485716096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463283.588188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463283.588339:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716096 00000100:00100000:3.0:1788463283.588348:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716096 00000100:00100000:3.0:1788463283.588399:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463283.588409:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485716096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463283.588453:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463283.588504:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485716096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463283.588522:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463283.589619:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485716096:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463283.843887:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463284.868798:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463284.981891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463284.981948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463284.982008:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776192 00000100:00100000:1.0:1788463284.982020:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776192 00000100:00100000:1.0:1788463284.982101:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:1.0:1788463284.982117:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466776192:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463284.982227:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466776192:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463284.982236:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:3.0:1788463284.982722:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776064 00000100:00100000:3.0:1788463284.982730:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776064 00000100:00100000:3.0:1788463284.982792:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 278 00000100:00100000:3.0:1788463284.982801:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466776064:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463284.982850:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466776064:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 50us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463284.982856:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 278 00000100:00080000:3.0:1788463284.982890:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463284.986731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463284.986777:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463284.986810:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463284.986851:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776320 00000100:00100000:1.0:1788463284.986864:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776320 00000100:00100000:1.0:1788463284.986946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:1.0:1788463284.986960:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776320:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463284.987056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776320:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463284.987064:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:0.0:1788463284.987401:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776448 00000100:00100000:0.0:1788463284.987407:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776448 00000100:00100000:0.0:1788463284.987455:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776576 00000100:00100000:0.0:1788463284.987458:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776576 00000100:00100000:0.0:1788463284.987493:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463284.987501:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776448:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463284.987540:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776448:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.987547:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463284.987560:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:0.0:1788463284.987566:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776576:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463284.987610:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776576:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 45us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.987617:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00080000:3.0:1788463284.987985:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463284.987990:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463284.987994:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788463285.893710:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463286.149931:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463286.149954:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485716224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463286.150033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463286.150099:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716224 00000100:00100000:0.0:1788463286.150106:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716224 00000100:00100000:0.0:1788463286.150167:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463286.150176:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485716224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463286.150207:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463286.150246:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485716224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463286.150252:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788463286.150270:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463286.150297:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e01c00 x1875339485716224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463286.150315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485716224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463286.659801:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485716352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463286.659876:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463286.660080:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716352 00000100:00100000:0.0:1788463286.660088:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716352 00000100:00100000:0.0:1788463286.660165:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463286.660174:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485716352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463286.660197:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463286.662309:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485716352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2125us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463286.662328:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788463286.662366:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463286.665397:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5500 x1875339485716352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463286.665425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485716352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463286.919106:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463287.571947:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788463287.685957:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485716480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463287.686030:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463287.686111:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716480 00000100:00100000:2.0:1788463287.686131:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716480 00000100:00100000:2.0:1788463287.686185:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463287.686198:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485716480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463287.686225:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463287.686268:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485716480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463287.686275:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788463287.686297:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788463287.686328:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da7100 x1875339485716480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463287.686346:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485716480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463287.690455:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485716608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463287.690531:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463287.690801:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716608 00000100:00100000:3.0:1788463287.690810:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716608 00000100:00100000:3.0:1788463287.690866:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463287.690877:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485716608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463287.690900:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463287.692563:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485716608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1681us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463287.692599:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788463287.692831:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463287.692999:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485716736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.693057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463287.693089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485717248:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.693114:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463287.693146:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485717760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.693170:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693306:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485716992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693335:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693358:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485717504:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693381:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693423:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485718016:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693445:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693466:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788463287.693471:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485716864:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693489:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693503:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485717376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693519:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693533:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485717888:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693549:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463287.693569:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717248 00000100:00100000:0.0:1788463287.693771:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717248 00000100:00100000:0.0:1788463287.693811:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716992 00000100:00100000:0.0:1788463287.693814:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716992 00000100:00100000:0.0:1788463287.693830:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463287.693838:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485717248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693889:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485717248:12345-0@lo:400:kworker.0 Request processed in 51us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.693895:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463287.693911:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463287.693918:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485716992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.693950:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485716992:12345-0@lo:400:kworker.0 Request processed in 33us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.693957:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463287.693974:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717504 00000100:00100000:0.0:1788463287.693977:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717504 00000100:00100000:0.0:1788463287.694005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718016 00000100:00100000:0.0:1788463287.694007:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718016 00000100:00100000:0.0:1788463287.694033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716864 00000100:00100000:0.0:1788463287.694037:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716864 00000100:00100000:0.0:1788463287.694046:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717376 00000100:00100000:0.0:1788463287.694048:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717376 00000100:00100000:0.0:1788463287.694058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717888 00000100:00100000:0.0:1788463287.694061:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717888 00000100:00100000:0.0:1788463287.694073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463287.694079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485717504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694111:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485717504:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.694128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463287.694142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463287.694148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485718016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694174:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485718016:12345-0@lo:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.694180:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463287.694191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463287.694336:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485716864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694368:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485716864:12345-0@lo:400:kworker.0 Request processed in 35us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.694374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463287.694387:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463287.694392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485717376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694537:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485717376:12345-0@lo:400:kworker.0 Request processed in 144us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.694543:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463287.694555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788463287.694567:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485717888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694698:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485717888:12345-0@lo:400:kworker.0 Request processed in 131us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463287.694704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788463287.694724:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463287.694727:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463287.694753:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485716864:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694764:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485717376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694772:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485717888:0@lo:400:kworker.0 00000100:00100000:0.0:1788463287.694780:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485716992:0@lo:400:kworker.0 00010000:00080000:0.0:1788463287.694790:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa19180 x1875339485717504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463287.694799:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485717504:0@lo:400:kworker.0 00010000:00080000:0.0:1788463287.694807:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c0a80 x1875339485718016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463287.694815:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485718016:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.694937:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788463287.694952:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485717120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.694989:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463287.695020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485717632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.695044:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463287.695077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485717248:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.695099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485716736 00000100:00100000:1.0:1788463287.695103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485716736 00000100:00100000:1.0:1788463287.695148:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788463287.695155:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485716736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.695742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485716736:12345-0@lo:400:kworker.0 Request processed in 584us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463287.695749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788463287.695788:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717760 00000100:00100000:1.0:1788463287.695792:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717760 00000100:00100000:1.0:1788463287.695819:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717632 00000100:00100000:1.0:1788463287.695822:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717632 00000100:00100000:1.0:1788463287.695841:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788463287.695849:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485717760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.695884:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485717760:12345-0@lo:400:kworker.0 Request processed in 36us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463287.695890:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788463287.695901:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463287.695907:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.695929:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485717632:12345-0@lo:400:kworker.0 Request processed in 23us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463287.695935:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463287.695951:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485717120 00000100:00100000:1.0:1788463287.695962:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485717120 00000100:00100000:1.0:1788463287.695982:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463287.695987:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485717120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.696014:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485717120:12345-0@lo:400:kworker.0 Request processed in 27us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463287.696020:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463287.696066:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485717120:0@lo:400:kworker.0 00010000:00080000:1.0:1788463287.696078:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa18380 x1875339485717632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463287.696088:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485717632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463287.696098:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485716736:0@lo:400:kworker.0 00010000:00080000:1.0:1788463287.696108:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1aa00 x1875339485717760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463287.696116:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485717760:0@lo:400:kworker.0 00010000:00080000:2.0:1788463287.696321:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa18e00 x1875339485716608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463287.696340:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485716608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788463287.942945:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463288.195939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485718144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463288.196040:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463288.196206:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718144 00000100:00100000:3.0:1788463288.196222:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718144 00000100:00100000:3.0:1788463288.196291:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788463288.196301:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485718144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463288.196338:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463288.196389:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485718144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463288.196396:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463288.196625:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485718144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463288.708809:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485718272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463288.708906:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463288.709079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718272 00000100:00100000:3.0:1788463288.709090:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718272 00000100:00100000:3.0:1788463288.709161:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463288.709171:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485718272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463288.709211:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463288.711461:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485718272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2284us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463288.711475:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788463288.711743:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485718272:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463288.963849:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463289.989935:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463290.094384:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463290.094426:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463290.094455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463290.094483:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776960 00000100:00100000:1.0:1788463290.094492:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776960 00000100:00100000:1.0:1788463290.094548:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776832 00000100:00100000:1.0:1788463290.094551:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776832 00000100:00100000:1.0:1788463290.094593:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:1.0:1788463290.094604:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776960:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463290.094673:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466776960:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463290.094688:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:1.0:1788463290.094705:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:1.0:1788463290.094711:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466776832:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463290.094739:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466776832:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463290.094745:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:2.0:1788463290.094930:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466776704 00000100:00100000:2.0:1788463290.094935:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466776704 00000100:00100000:2.0:1788463290.094976:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 280 00000100:00100000:2.0:1788463290.094984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466776704:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463290.095017:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466776704:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463290.095023:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 280 00000100:00080000:0.0:1788463290.095217:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463290.095222:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463290.107818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463290.107863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463290.107920:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777088 00000100:00100000:0.0:1788463290.107932:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777088 00000100:00100000:0.0:1788463290.108005:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777216 00000100:00100000:0.0:1788463290.108016:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777216 00000100:00080000:1.0:1788463290.108039:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463290.108045:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463290.108050:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:0.0:1788463290.108063:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466777088:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:0.0:1788463290.108140:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3972d 00000100:00080000:0.0:1788463290.108150:0:8439:0:(import.c:65:import_set_state_nolock()) ffff961787a5b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463290.108201:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788463290.108228:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463290.108378:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+2:2399:x1875339466777088:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 317us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463290.108387:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:0.0:1788463290.108406:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463290.108412:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466777216:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:0.0:1788463290.108425:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39734 00000100:00080000:0.0:1788463290.108432:0:8439:0:(import.c:65:import_set_state_nolock()) ffff961787059800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463290.108456:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788463290.108534:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+2:2399:x1875339466777216:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 121us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463290.108542:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00010000:00010000:0.0:1788463290.108568:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463291.014309:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463291.274196:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485718400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463291.274268:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463291.274420:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718400 00000100:00100000:0.0:1788463291.274428:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718400 00000100:00100000:0.0:1788463291.274493:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788463291.274504:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485718400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463291.274532:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463291.274610:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485718400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463291.274617:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788463291.274685:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e00380 x1875339485718400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463291.274703:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485718400:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788463291.274761:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463291.780911:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463291.780934:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485718528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463291.780995:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463291.781068:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718528 00000100:00100000:2.0:1788463291.781076:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718528 00000100:00100000:2.0:1788463291.781139:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788463291.781156:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485718528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463291.781179:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463291.781224:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485718528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463291.781231:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788463291.781250:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463291.781281:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6300 x1875339485718528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463291.781299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485718528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463292.035703:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463292.803806:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485719040:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.803880:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.803927:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485719552:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.803950:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.803971:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485720064:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.803991:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.804012:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463292.804028:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485718912:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.804054:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.804071:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485719424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.804104:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.804124:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485719936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.804146:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463292.804183:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719040 00000100:00100000:1.0:1788463292.804191:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719040 00000100:00100000:1.0:1788463292.804245:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719424 00000100:00100000:1.0:1788463292.804247:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719424 00000100:00100000:1.0:1788463292.804267:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719936 00000100:00100000:1.0:1788463292.804270:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719936 00000100:00100000:1.0:1788463292.804285:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463292.804293:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485719040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804454:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485718656:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804522:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485719168:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804546:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804565:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485719680:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804604:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804622:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485720192:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804640:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804659:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788463292.804665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485718784:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804686:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804696:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485719296:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463292.804722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485719808:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463292.804776:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463292.804832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718656 00000100:00100000:2.0:1788463292.804836:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718656 00000100:00100000:2.0:1788463292.804871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788463292.804879:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485718656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.804916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485718656:12345-0@lo:400:kworker.0 Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.804923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788463292.804959:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718912 00000100:00100000:2.0:1788463292.804962:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718912 00000100:00100000:2.0:1788463292.804990:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719168 00000100:00100000:2.0:1788463292.804993:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719168 00000100:00100000:2.0:1788463292.805007:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788463292.805014:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485718912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.805062:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485718912:12345-0@lo:400:kworker.0 Request processed in 48us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.805068:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788463292.805082:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788463292.805090:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485719168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.805119:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485719168:12345-0@lo:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.805125:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788463292.805146:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719552 00000100:00100000:2.0:1788463292.805149:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719552 00000100:00100000:2.0:1788463292.805167:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720064 00000100:00100000:2.0:1788463292.805170:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720064 00000100:00100000:2.0:1788463292.805188:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719680 00000100:00100000:0.0:1788463292.805293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485720320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463292.805324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463292.805360:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720320 00000100:00100000:0.0:1788463292.805363:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720320 00000100:00100000:0.0:1788463292.805392:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463292.805398:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485720320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463292.805420:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463292.805455:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485720320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463292.805461:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463292.805471:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485719040:12345-0@lo:400:kworker.0 Request processed in 1178us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463292.805478:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463292.805492:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485718784 00000100:00100000:1.0:1788463292.805494:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485718784 00010000:00080000:0.0:1788463292.805500:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5c00 x1875339485720320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463292.805509:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719296 00000100:00100000:1.0:1788463292.805512:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719296 00000100:00100000:0.0:1788463292.805517:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485720320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463292.805529:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485719808 00000100:00100000:1.0:1788463292.805531:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719808 00000100:00100000:1.0:1788463292.805551:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463292.805558:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485719424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.805607:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485719424:12345-0@lo:400:kworker.0 Request processed in 50us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463292.805613:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463292.805625:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463292.805631:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.805656:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485719936:12345-0@lo:400:kworker.0 Request processed in 26us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463292.805662:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463292.805674:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463292.805680:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485718784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463292.805680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788463292.805686:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485719296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463292.805717:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485718784:12345-0@lo:400:kworker.0 Request processed in 37us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463292.805717:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485719296:12345-0@lo:400:kworker.0 Request processed in 30us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463292.805723:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463292.805854:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485719680 00000100:00100000:2.0:1788463292.805876:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720192 00000100:00100000:2.0:1788463292.805878:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720192 00000100:00100000:2.0:1788463292.805893:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463292.805901:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485719552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.805947:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485719552:12345-0@lo:400:kworker.0 Request processed in 48us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.805953:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463292.805964:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463292.805970:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485720064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.806001:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fe18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485720064:12345-0@lo:400:kworker.0 Request processed in 32us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.806008:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463292.806172:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463292.806179:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485719680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.806208:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485719680:12345-0@lo:400:kworker.0 Request processed in 30us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.806214:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463292.806224:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463292.806230:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485720192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.806252:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485720192:12345-0@lo:400:kworker.0 Request processed in 22us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.806257:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463292.806289:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485720448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463292.806544:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485718784:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.806544:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463292.806566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485719296:0@lo:400:kworker.0 00000100:00080000:2.0:1788463292.806613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463292.806624:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463292.806636:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720448 00000100:00100000:2.0:1788463292.806641:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720448 00000100:00100000:2.0:1788463292.806667:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463292.806674:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485720448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463292.806686:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463292.806688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485718656:0@lo:400:kworker.0 00000100:00100000:3.0:1788463292.806707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485719168:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.806724:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0700 x1875339485719680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463292.806730:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485720448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.806744:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463292.806747:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485719680:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.806765:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1180 x1875339485720192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788463292.806781:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc22d80 x1875339485720448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463292.806802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485720192:0@lo:400:kworker.0 00000100:00100000:2.0:1788463292.806807:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485720448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463292.810702:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788463292.810758:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788463292.810775:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485719808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463292.810888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485719808:12345-0@lo:400:kworker.0 Request processed in 121us (6133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463292.810903:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788463292.810974:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485719808:0@lo:400:kworker.0 00000100:00100000:3.0:1788463292.811469:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485718912:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.811487:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0e00 x1875339485719424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463292.811497:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485719424:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.811510:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec2300 x1875339485719936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463292.811519:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485719936:0@lo:400:kworker.0 00000100:00100000:3.0:1788463292.811533:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485719040:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.811546:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1880 x1875339485719552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463292.811554:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485719552:0@lo:400:kworker.0 00010000:00080000:3.0:1788463292.811783:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1f80 x1875339485720064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463292.811794:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485720064:0@lo:400:kworker.0 00010000:00010000:0.0:1788463293.060664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463293.319600:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485720576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463293.319693:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463293.320114:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720576 00000100:00100000:2.0:1788463293.320124:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720576 00000100:00100000:2.0:1788463293.320179:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463293.320189:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485720576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463293.320226:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463293.320276:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485720576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463293.320283:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463293.320558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485720576:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788463293.379499:0:10944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing yml_node 00000100:00100000:1.0:1788463293.836974:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463293.837012:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485720704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463293.837084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463293.837143:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720704 00000100:00100000:1.0:1788463293.837151:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720704 00000100:00100000:1.0:1788463293.837198:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463293.837207:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485720704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463293.837413:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463293.837469:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485720704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 262us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463293.837477:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463293.837525:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485720704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463294.085425:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463295.107746:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463295.221368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463295.221417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463295.221454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463295.221548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777344 00000100:00100000:1.0:1788463295.221558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777344 00000100:00100000:3.0:1788463295.221562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777600 00000100:00100000:3.0:1788463295.221566:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777600 00000100:00100000:1.0:1788463295.221638:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 282 00000100:00100000:1.0:1788463295.221647:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466777344:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463295.221652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777472 00000100:00100000:3.0:1788463295.221655:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777472 00000100:00100000:3.0:1788463295.221674:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 99 00000100:00100000:3.0:1788463295.221681:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466777600:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463295.221715:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466777600:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 35us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463295.221722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 99 00000100:00100000:3.0:1788463295.221740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 100 00000100:00100000:3.0:1788463295.221747:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466777472:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:2.0:1788463295.221813:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463295.221817:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463295.226922:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466777472:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 5164us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463295.226937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 100 00000100:00100000:1.0:1788463295.230409:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466777344:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 5264us (5555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463295.230497:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 282 00000001:00100000:2.0:1788463295.370055:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:2.0:1788463295.370078:0:8434:0:(genops.c:885:class_export_put()) final put ffff961787a5e000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:1.0:1788463295.370198:0:1365:0:(genops.c:844:class_export_destroy()) destroying export ffff961787a5e000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-OST0000 00000020:00000080:1.0:1788463295.370256:0:1365:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787a5b800 for lustre-OST0000 00000001:00100000:1.0:1788463295.370487:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:1.0:1788463295.370498:0:9518:0:(genops.c:885:class_export_put()) final put ffff961787059000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:2.0:1788463295.370567:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787059000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-OST0001 00000020:00000080:2.0:1788463295.370737:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787059800 for lustre-OST0001 00010000:00010000:0.0:1788463296.135328:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463296.387895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485720832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463296.387980:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463296.388053:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720832 00000100:00100000:0.0:1788463296.388062:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720832 00000100:00100000:0.0:1788463296.388126:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463296.388137:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485720832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463296.388166:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463296.388218:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485720832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463296.388225:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788463296.388396:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e02a00 x1875339485720832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463296.388415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485720832:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788463296.388546:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463296.899830:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485720960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463296.899905:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463296.904043:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485720960 00000100:00100000:2.0:1788463296.904059:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485720960 00000100:00100000:2.0:1788463296.904240:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463296.904253:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485720960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463296.904292:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463296.904393:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485720960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463296.904401:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788463296.904757:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20700 x1875339485720960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463296.904780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485720960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463296.909453:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463297.156422:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463297.924010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485721344:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924139:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924171:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485722368:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924236:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924260:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788463297.924267:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485721216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924290:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924316:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485721728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485722240:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.924371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463297.924397:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721856 00000100:00100000:1.0:1788463297.924404:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721856 00000100:00100000:1.0:1788463297.924453:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722368 00000100:00100000:1.0:1788463297.924456:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722368 00000100:00100000:1.0:1788463297.924470:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721216 00000100:00100000:1.0:1788463297.924472:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721216 00000100:00100000:1.0:1788463297.924503:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721728 00000100:00100000:1.0:1788463297.924506:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721728 00000100:00100000:1.0:1788463297.924516:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722240 00000100:00100000:1.0:1788463297.924518:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722240 00000100:00100000:1.0:1788463297.924533:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463297.924540:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485721856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925043:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485721856:12345-0@lo:400:kworker.0 Request processed in 499us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.925051:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463297.925073:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463297.925080:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485722368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925107:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485722368:12345-0@lo:400:kworker.0 Request processed in 29us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.925113:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463297.925124:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788463297.925129:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925151:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485721216:12345-0@lo:400:kworker.0 Request processed in 22us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.925156:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788463297.925166:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788463297.925170:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485721728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925396:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485721728:12345-0@lo:400:kworker.0 Request processed in 223us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.925402:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788463297.925417:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788463297.925425:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485722240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925463:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485722240:12345-0@lo:400:kworker.0 Request processed in 40us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.925470:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788463297.925495:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463297.925498:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463297.925526:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485721216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485721728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.925545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485722240:0@lo:400:kworker.0 00010000:00080000:1.0:1788463297.925556:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787eab800 x1875339485721856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463297.925565:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485721856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.926423:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485721472:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.926472:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.926516:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485721984:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.926542:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.926561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485722496:0@lo:400:kworker.0 00010000:00080000:1.0:1788463297.926842:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea8e00 x1875339485722368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463297.926858:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485722368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.927017:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.927046:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788463297.927065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485721088:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.927096:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.927117:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485721600:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.927140:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.927157:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485722112:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.927176:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.927191:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485722624:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.927209:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463297.927239:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721472 00000100:00100000:3.0:1788463297.927245:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721472 00000100:00100000:3.0:1788463297.927286:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788463297.927436:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721984 00000100:00100000:0.0:1788463297.927441:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721984 00000100:00100000:0.0:1788463297.927462:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722496 00000100:00100000:0.0:1788463297.927465:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722496 00000100:00100000:0.0:1788463297.927485:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722112 00000100:00100000:0.0:1788463297.927487:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722112 00000100:00100000:0.0:1788463297.927496:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722624 00000100:00100000:0.0:1788463297.927498:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722624 00000100:00100000:0.0:1788463297.927513:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463297.927520:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485721984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.927609:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485721984:12345-0@lo:400:kworker.0 Request processed in 56us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.927626:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463297.927643:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788463297.927649:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485722496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.927678:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485722496:12345-0@lo:400:kworker.0 Request processed in 29us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.927684:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788463297.927694:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463297.927699:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485722112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.927720:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485722112:12345-0@lo:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.927725:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463297.927733:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788463297.927738:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485722624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.927756:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485722624:12345-0@lo:400:kworker.0 Request processed in 18us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.927761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788463297.927776:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788463297.927799:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea8a80 x1875339485722112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463297.927809:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485722112:0@lo:400:kworker.0 00010000:00080000:0.0:1788463297.927817:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea8700 x1875339485722624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463297.927825:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485722624:0@lo:400:kworker.0 00010000:00080000:0.0:1788463297.927834:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787eabb80 x1875339485721984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463297.927847:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485721984:0@lo:400:kworker.0 00010000:00080000:0.0:1788463297.927857:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea9880 x1875339485722496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463297.927864:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485722496:0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.927913:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721344 00000100:00100000:0.0:1788463297.927917:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721344 00000100:00100000:0.0:1788463297.927951:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721600 00000100:00100000:0.0:1788463297.927953:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721600 00000100:00100000:0.0:1788463297.927965:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788463297.927970:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485721344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.928002:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485721344:12345-0@lo:400:kworker.0 Request processed in 32us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.928008:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788463297.928019:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788463297.928024:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485721600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.928054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485721600:12345-0@lo:400:kworker.0 Request processed in 29us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.928059:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788463297.928083:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485721600:0@lo:400:kworker.0 00000100:00100000:1.0:1788463297.928520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485721344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463297.928752:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485721088 00000100:00100000:2.0:1788463297.928758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485721088 00000100:00100000:2.0:1788463297.928796:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788463297.928802:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485721088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463297.928842:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485721088:12345-0@lo:400:kworker.0 Request processed in 40us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.928847:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788463297.928931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485722752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463297.928962:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463297.928997:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722752 00000100:00100000:2.0:1788463297.929001:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722752 00000100:00100000:2.0:1788463297.929039:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463297.929046:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485722752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463297.929071:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463297.929107:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485722752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.929126:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788463297.929158:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20700 x1875339485722752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463297.929173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485722752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463297.930785:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485721472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.930868:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485721472:12345-0@lo:400:kworker.0 Request processed in 3574us (4395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.930876:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788463297.931133:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485721088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463297.931147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485721472:0@lo:400:kworker.0 00000100:00100000:3.0:1788463297.932310:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463297.932330:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485722880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463297.932386:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463297.933410:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485722880 00000100:00100000:0.0:1788463297.933422:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485722880 00000100:00100000:0.0:1788463297.933500:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463297.933509:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485722880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463297.933532:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463297.933835:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485722880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 325us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.933842:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788463297.935080:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e03480 x1875339485722880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463297.935106:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485722880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788463298.180126:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463298.438670:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485723008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463298.438773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463298.438883:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723008 00000100:00100000:2.0:1788463298.438894:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723008 00000100:00100000:2.0:1788463298.438968:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463298.438979:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485723008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463298.439468:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463298.439541:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485723008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 563us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.439549:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463298.439642:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485723008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463298.948935:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485723136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463298.949054:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463298.949505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723136 00000100:00100000:3.0:1788463298.949526:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723136 00000100:00100000:3.0:1788463298.949627:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788463298.949641:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485723136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463298.949710:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463298.949774:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485723136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463298.949781:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788463298.951983:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485723136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463299.210870:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463299.299178:0:11128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:2.0:1788463300.232127:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463300.333280:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463300.333336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463300.333453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463300.333669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777728 00000100:00100000:1.0:1788463300.333684:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777728 00000100:00100000:1.0:1788463300.333761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 284 00000100:00100000:1.0:1788463300.333774:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2402:x1875339466777728:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463300.333898:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2402:x1875339466777728:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 126us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463300.333907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 284 00000100:00100000:1.0:1788463300.333954:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777984 00000100:00100000:1.0:1788463300.333958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777984 00000100:00100000:1.0:1788463300.334002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466777856 00000100:00100000:1.0:1788463300.334005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466777856 00000100:00100000:1.0:1788463300.334030:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 107 00000100:00100000:1.0:1788463300.334037:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466777984:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463300.334085:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466777984:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 48us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463300.334092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 107 00000100:00100000:1.0:1788463300.334106:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 108 00000100:00100000:1.0:1788463300.334112:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466777856:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463300.334137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466777856:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463300.334144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 108 00000100:00080000:1.0:1788463300.334262:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463300.334267:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788463301.251881:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463301.510164:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485723264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463301.511064:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463301.520667:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723264 00000100:00100000:2.0:1788463301.520836:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723264 00000100:00100000:2.0:1788463301.522089:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463301.522113:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485723264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463301.522163:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463301.522378:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485723264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 277us (11331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463301.522411:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788463301.522986:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463301.526490:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e01500 x1875339485723264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463301.526524:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485723264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463302.024762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485723392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463302.024856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463302.025015:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723392 00000100:00100000:2.0:1788463302.025024:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723392 00000100:00100000:2.0:1788463302.025094:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463302.025106:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485723392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463302.025133:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463302.025191:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485723392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463302.025201:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788463302.025249:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dc700 x1875339485723392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463302.025271:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485723392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463302.025337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463302.280356:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463302.623993:0:11227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788463303.043939:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463303.043964:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485723520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463303.044035:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463303.044097:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723520 00000100:00100000:1.0:1788463303.044105:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723520 00000100:00100000:1.0:1788463303.044178:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463303.044187:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485723520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463303.044218:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463303.044264:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485723520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463303.044271:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788463303.044439:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463303.044470:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9dc700 x1875339485723520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463303.044488:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485723520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463303.044757:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485723904:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.044793:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.044815:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485724416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.044853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.044869:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485724928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.044889:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.044905:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788463303.044910:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485723776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.044931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.044945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.044965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.044988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.045009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463303.045030:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723904 00000100:00100000:2.0:1788463303.045035:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723904 00000100:00100000:2.0:1788463303.045068:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463303.045075:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045205:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485724032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045234:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045246:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045268:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045304:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485725056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045325:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045345:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788463303.045350:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485723648:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045450:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485724160:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045492:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045511:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.045542:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724416 00000100:00100000:3.0:1788463303.045546:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724416 00000100:00100000:3.0:1788463303.045605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724928 00000100:00100000:3.0:1788463303.045609:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724928 00000100:00100000:3.0:1788463303.045621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723776 00000100:00100000:3.0:1788463303.045623:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723776 00000100:00100000:3.0:1788463303.045631:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724288 00000100:00100000:3.0:1788463303.045633:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724288 00000100:00100000:3.0:1788463303.045641:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724800 00000100:00100000:3.0:1788463303.045644:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724800 00000100:00100000:3.0:1788463303.045652:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724032 00000100:00100000:3.0:1788463303.045654:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724032 00000100:00100000:3.0:1788463303.045664:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463303.045670:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485724416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485724416:12345-0@lo:400:kworker.0 Request processed in 32us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045708:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463303.045721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463303.045726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485724928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045749:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485724928:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045755:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463303.045764:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788463303.045769:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485723776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485723776:12345-0@lo:400:kworker.0 Request processed in 20us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788463303.045803:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463303.045808:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485724288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045842:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485724288:12345-0@lo:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463303.045863:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788463303.045868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485724800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045891:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485724800:12345-0@lo:400:kworker.0 Request processed in 24us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788463303.045903:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463303.045907:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485724032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045931:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485724032:12345-0@lo:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.045935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463303.045951:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724160 00000100:00100000:3.0:1788463303.045954:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724160 00000100:00100000:3.0:1788463303.045968:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463303.045973:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485724160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.045998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485724160:12345-0@lo:400:kworker.0 Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.046003:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463303.046020:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724544 00000100:00100000:3.0:1788463303.046023:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724544 00000100:00100000:3.0:1788463303.046060:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725056 00000100:00100000:3.0:1788463303.046063:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725056 00000100:00100000:3.0:1788463303.046079:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485724672 00000100:00100000:3.0:1788463303.046081:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485724672 00000100:00100000:3.0:1788463303.046090:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463303.046096:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046147:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485724544:12345-0@lo:400:kworker.0 Request processed in 51us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.046153:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463303.046164:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463303.046169:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485725056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046191:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485725056:12345-0@lo:400:kworker.0 Request processed in 23us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.046196:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463303.046205:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463303.046211:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046235:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485724672:12345-0@lo:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.046241:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463303.046263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485723648 00000100:00100000:3.0:1788463303.046267:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485723648 00000100:00100000:3.0:1788463303.046292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788463303.046298:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485723648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485723648:12345-0@lo:400:kworker.0 Request processed in 28us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.046331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:3.0:1788463303.046363:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463303.046367:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463303.046369:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463303.046371:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463303.046398:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485723648:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046410:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485724160:0@lo:400:kworker.0 00010000:00080000:3.0:1788463303.046432:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f2a00 x1875339485724672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463303.046442:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463303.046453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485724032:0@lo:400:kworker.0 00010000:00080000:3.0:1788463303.046462:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f0a80 x1875339485724544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463303.046470:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485724544:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.046804:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485723904:12345-0@lo:400:kworker.0 Request processed in 1726us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463303.046810:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463303.046856:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485723776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.046866:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.046877:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485724800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.046887:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485723904:0@lo:400:kworker.0 00010000:00080000:2.0:1788463303.046897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843e5c00 x1875339485724416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463303.046905:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485724416:0@lo:400:kworker.0 00010000:00080000:2.0:1788463303.046915:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f2d80 x1875339485724928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463303.046922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485724928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463303.048395:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485725184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463303.048458:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463303.048553:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725184 00000100:00100000:1.0:1788463303.048560:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725184 00000100:00100000:1.0:1788463303.048631:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463303.048640:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485725184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463303.048664:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463303.048707:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485725184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463303.048714:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788463303.048870:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787eaaa00 x1875339485725184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463303.048904:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485725184:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788463303.049215:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b47100 x1875339485725056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463303.049231:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485725056:0@lo:400:kworker.0 00010000:00010000:2.0:1788463303.299714:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463303.564170:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463303.564193:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485725312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463303.564264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463303.564612:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725312 00000100:00100000:3.0:1788463303.564620:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725312 00000100:00100000:3.0:1788463303.564680:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463303.564689:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485725312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463303.564725:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463303.564779:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485725312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463303.564785:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463303.565048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485725312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463304.072326:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485725440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463304.072405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463304.073989:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725440 00000100:00100000:2.0:1788463304.074002:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725440 00000100:00100000:2.0:1788463304.074077:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788463304.074088:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485725440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463304.076152:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463304.076256:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485725440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2168us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463304.076266:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463304.077251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485725440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463304.324699:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463305.348200:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463305.458990:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463305.459069:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463305.459107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463305.459160:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778368 00000100:00100000:2.0:1788463305.459170:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778368 00000100:00100000:2.0:1788463305.459228:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778240 00000100:00100000:2.0:1788463305.459231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778240 00000100:00100000:2.0:1788463305.459251:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:2.0:1788463305.459262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466778368:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463305.459329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466778368:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463305.459336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:2.0:1788463305.459352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:2.0:1788463305.459358:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466778240:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463305.459396:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466778240:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463305.459403:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:0.0:1788463305.459542:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778112 00000100:00100000:0.0:1788463305.459547:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778112 00000100:00100000:0.0:1788463305.459618:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 286 00000100:00100000:0.0:1788463305.459627:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466778112:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463305.459662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466778112:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 36us (680us total) trans 0 rc 0/0 00000100:00080000:3.0:1788463305.459669:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463305.459669:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 286 00000100:00080000:3.0:1788463305.459676:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788463305.644872:0:11324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:2.0:1788463306.373364:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463306.628065:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463306.628090:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485725568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463306.628164:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463306.629211:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725568 00000100:00100000:1.0:1788463306.629223:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725568 00000100:00100000:1.0:1788463306.629317:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463306.629328:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485725568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463306.629378:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463306.629448:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485725568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463306.629456:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788463306.629518:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e03480 x1875339485725568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463306.629537:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485725568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788463306.629987:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463307.139872:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463307.139896:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485725696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463307.139973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463307.140416:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725696 00000100:00100000:2.0:1788463307.140426:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725696 00000100:00100000:2.0:1788463307.140639:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463307.140652:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485725696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463307.140681:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463307.140756:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485725696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463307.140764:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788463307.144752:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463307.145931:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f2a00 x1875339485725696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463307.145976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485725696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463307.395888:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463308.165814:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485726080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.165897:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485726208:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.165981:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166059:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485726720:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166100:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166129:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166153:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166183:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463308.166190:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485726592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166214:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166241:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485727104:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166435:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166477:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726208 00000100:00100000:2.0:1788463308.166486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726208 00000100:00100000:1.0:1788463308.166550:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485725824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166551:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726592 00000100:00100000:2.0:1788463308.166557:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726592 00000100:00100000:1.0:1788463308.166622:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.166657:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485726336:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166762:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727104 00000100:00100000:2.0:1788463308.166766:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727104 00000100:00100000:2.0:1788463308.166786:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788463308.166796:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485726208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.166885:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485726208:12345-0@lo:400:kworker.0 Request processed in 88us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.166894:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788463308.166921:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788463308.166930:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485726592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.166968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.166977:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485726592:12345-0@lo:400:kworker.0 Request processed in 47us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.166985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788463308.167000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788463308.167008:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485727104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.167053:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485727104:12345-0@lo:400:kworker.0 Request processed in 47us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.167059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788463308.167073:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726080 00000100:00100000:3.0:1788463308.167084:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726080 00000100:00100000:2.0:1788463308.167088:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726720 00000100:00100000:2.0:1788463308.167095:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726720 00000100:00100000:2.0:1788463308.167144:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727232 00000100:00100000:2.0:1788463308.167148:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727232 00000100:00100000:3.0:1788463308.167163:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788463308.167183:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485726080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.167192:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463308.167215:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485726720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.168183:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485726720:12345-0@lo:400:kworker.0 Request processed in 966us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.168193:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463308.168221:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463308.168234:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.168434:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485727232:12345-0@lo:400:kworker.0 Request processed in 206us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.168442:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788463308.168541:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463308.168546:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463308.168551:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463308.168604:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485727616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463308.168652:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463308.168706:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727616 00000100:00100000:2.0:1788463308.168714:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727616 00000100:00100000:3.0:1788463308.169059:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485726080:12345-0@lo:400:kworker.0 Request processed in 1877us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.169073:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463308.169973:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170020:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485726848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170073:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485727360:0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170139:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788463308.170160:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485725952:0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485726464:0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170240:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485726976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170259:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485727488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463308.170313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.170359:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725824 00000100:00100000:1.0:1788463308.170369:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725824 00000100:00100000:1.0:1788463308.170421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788463308.170430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485725824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.170481:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485725824:12345-0@lo:400:kworker.0 Request processed in 51us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463308.170488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788463308.170525:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727488 00000100:00100000:1.0:1788463308.170529:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727488 00000100:00100000:1.0:1788463308.170548:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463308.170554:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485727488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463308.170597:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463308.170629:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485727488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463308.170636:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788463308.170674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea9880 x1875339485727488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463308.170695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485727488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463308.170705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485725824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463308.172547:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463308.172568:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485727616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463308.172646:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463308.172761:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485727616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (4107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463308.172770:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463308.172809:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726336 00000100:00100000:2.0:1788463308.172819:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726336 00000100:00100000:1.0:1788463308.172981:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788463308.173007:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.173104:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485726336:12345-0@lo:400:kworker.0 Request processed in 110us (3134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463308.173111:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788463308.173178:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485726336:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.173688:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726848 00000100:00100000:3.0:1788463308.173697:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726848 00000100:00100000:3.0:1788463308.173750:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727360 00000100:00100000:3.0:1788463308.173754:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727360 00000100:00100000:3.0:1788463308.173777:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463308.173785:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.173849:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485726848:12345-0@lo:400:kworker.0 Request processed in 65us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.173855:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463308.173871:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463308.173879:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485727360:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788463308.173898:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1f80 x1875339485726848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463308.173911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.173917:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485727360:12345-0@lo:400:kworker.0 Request processed in 37us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.173924:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788463308.173930:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0e00 x1875339485727360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463308.173940:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485727360:0@lo:400:kworker.0 00010000:00080000:3.0:1788463308.173972:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20700 x1875339485726592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463308.173991:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485726592:0@lo:400:kworker.0 00010000:00080000:3.0:1788463308.174009:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec3b80 x1875339485727104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463308.174018:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485727104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174029:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485726208:0@lo:400:kworker.0 00010000:00080000:3.0:1788463308.174040:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c3800 x1875339485726720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463308.174048:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485726720:0@lo:400:kworker.0 00010000:00080000:3.0:1788463308.174060:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec2300 x1875339485727232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463308.174068:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485727232:0@lo:400:kworker.0 00010000:00080000:3.0:1788463308.174108:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1500 x1875339485727616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463308.174125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485727616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463308.174140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485726080:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174188:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485725952 00000100:00100000:3.0:1788463308.174192:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485725952 00000100:00100000:3.0:1788463308.174216:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726464 00000100:00100000:3.0:1788463308.174220:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726464 00000100:00100000:3.0:1788463308.174234:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485726976 00000100:00100000:3.0:1788463308.174237:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485726976 00000100:00100000:3.0:1788463308.174251:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788463308.174264:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485725952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174313:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485725952:12345-0@lo:400:kworker.0 Request processed in 50us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.174319:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788463308.174331:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788463308.174337:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485726464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463308.174363:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485725952:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174371:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485726464:12345-0@lo:400:kworker.0 Request processed in 33us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.174381:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788463308.174381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485726464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174399:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788463308.174408:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463308.174451:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485726976:12345-0@lo:400:kworker.0 Request processed in 45us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463308.174457:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788463308.174482:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485726976:0@lo:400:kworker.0 00000100:00080000:3.0:1788463308.174505:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463308.174511:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788463308.228807:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 15:21:46 EDT 2026 00010000:00010000:0.0:1788463308.419785:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463308.676034:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485727744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463308.676107:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463308.676441:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727744 00000100:00100000:1.0:1788463308.676449:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727744 00000100:00100000:1.0:1788463308.676506:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463308.676515:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485727744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463308.676553:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463308.676668:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485727744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463308.676675:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463308.676736:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485727744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463309.188919:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463309.188943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485727872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463309.189024:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463309.189084:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485727872 00000100:00100000:3.0:1788463309.189092:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485727872 00000100:00100000:3.0:1788463309.189139:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463309.189148:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485727872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463309.189191:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463309.189245:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485727872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463309.189262:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788463309.189291:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485727872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463309.445631:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463310.467707:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463310.574455:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463310.574502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463310.574568:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778496 00000100:00100000:2.0:1788463310.574615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778496 00000100:00100000:2.0:1788463310.574735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 288 00000100:00100000:2.0:1788463310.574747:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466778496:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463310.574821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466778496:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463310.574828:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 288 00000100:00100000:0.0:1788463310.575860:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778752 00000100:00100000:0.0:1788463310.575869:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778752 00000100:00100000:0.0:1788463310.575936:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:0.0:1788463310.575946:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466778752:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463310.576024:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466778752:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 79us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463310.576032:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00080000:1.0:1788463310.579728:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463310.584380:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463310.587683:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778624 00000100:00100000:2.0:1788463310.587698:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778624 00000100:00100000:2.0:1788463310.587797:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:2.0:1788463310.587808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466778624:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463310.587900:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466778624:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 93us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463310.587909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00080000:3.0:1788463310.588504:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463311.493463:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463311.751410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485728000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463311.751481:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463311.751556:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728000 00000100:00100000:2.0:1788463311.751563:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728000 00000100:00100000:2.0:1788463311.751646:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788463311.751675:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485728000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463311.751706:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463311.751749:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485728000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463311.751756:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788463311.751777:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463311.751807:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0000 x1875339485728000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463311.751839:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485728000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463312.259890:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463312.259934:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463312.260005:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463312.260162:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728128 00000100:00100000:2.0:1788463312.260170:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728128 00000100:00100000:2.0:1788463312.260244:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463312.260253:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485728128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463312.260274:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463312.260322:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485728128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463312.260330:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788463312.260402:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0000 x1875339485728128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463312.260420:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485728128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463312.260478:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463312.515743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463313.285421:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463313.285453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485728256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463313.285562:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463313.290029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485728512:0@lo:400:kworker.0 00000100:00100000:3.0:1788463313.290142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463313.290215:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463313.290225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463313.290260:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463313.290311:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728256 00000100:00100000:3.0:1788463313.290322:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728256 00000100:00100000:3.0:1788463313.290395:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728384 00000100:00100000:3.0:1788463313.290398:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728384 00000100:00100000:3.0:1788463313.290421:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463313.290431:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485728256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463313.290486:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463313.290544:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485728256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463313.290552:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463313.290602:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463313.290609:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485728384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463313.290630:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463313.290663:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485728384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463313.290685:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788463313.290705:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788463313.290745:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e03800 x1875339485728256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463313.290769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485728256:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788463313.290807:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e03480 x1875339485728384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463313.290819:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485728384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463313.292711:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728512 00000100:00100000:0.0:1788463313.292732:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728512 00000100:00100000:0.0:1788463313.292821:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788463313.294672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485728512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463313.299494:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485728512:12345-0@lo:400:kworker.0 Request processed in 2003us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463313.299516:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788463313.300816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485728896:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.300912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.300955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485729408:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.300990:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463313.301030:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485729024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301076:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485729536:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301132:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485728768:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301167:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301185:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485729280:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301206:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301224:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485729792:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301244:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301266:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463313.301272:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485728640:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301292:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301309:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485729152:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301433:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301445:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485729664:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301464:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.301601:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728896 00000100:00100000:1.0:1788463313.301612:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728896 00000100:00100000:1.0:1788463313.301681:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729280 00000100:00100000:1.0:1788463313.301684:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729280 00000100:00100000:1.0:1788463313.301715:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729792 00000100:00100000:1.0:1788463313.301718:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729792 00000100:00100000:1.0:1788463313.301735:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728640 00000100:00100000:1.0:1788463313.301737:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728640 00000100:00100000:1.0:1788463313.301747:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729152 00000100:00100000:1.0:1788463313.301750:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729152 00000100:00100000:1.0:1788463313.301762:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729664 00000100:00100000:1.0:1788463313.301764:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729664 00000100:00100000:1.0:1788463313.301780:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463313.301790:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485728896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301857:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485728896:12345-0@lo:400:kworker.0 Request processed in 68us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.301865:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463313.301889:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463313.301897:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485729280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301931:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485729280:12345-0@lo:400:kworker.0 Request processed in 34us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.301937:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463313.301950:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788463313.301956:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.301984:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485729792:12345-0@lo:400:kworker.0 Request processed in 29us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.301998:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788463313.302010:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788463313.302016:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485728640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.302044:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485728640:12345-0@lo:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.302050:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788463313.302062:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788463313.302067:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485729152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.302094:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485729152:12345-0@lo:400:kworker.0 Request processed in 27us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.302100:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788463313.302111:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788463313.302116:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485729664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.302145:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485729664:12345-0@lo:400:kworker.0 Request processed in 29us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.302150:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788463313.302172:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729408 00000100:00100000:1.0:1788463313.302176:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729408 00000100:00100000:1.0:1788463313.302206:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729536 00000100:00100000:1.0:1788463313.302209:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729536 00000100:00100000:1.0:1788463313.302230:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463313.302237:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485729408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.302273:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485729408:12345-0@lo:400:kworker.0 Request processed in 35us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.302280:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463313.302301:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788463313.302307:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485729536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463313.302546:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485728512:0@lo:400:kworker.0 00000100:00100000:3.0:1788463313.305913:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729024 00000100:00100000:3.0:1788463313.305936:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729024 00000100:00100000:3.0:1788463313.306019:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485728768 00000100:00100000:3.0:1788463313.306023:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485728768 00000100:00100000:3.0:1788463313.306044:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788463313.306056:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485729024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.306619:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485729536:12345-0@lo:400:kworker.0 Request processed in 4307us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.306642:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463313.310688:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485729024:12345-0@lo:400:kworker.0 Request processed in 4615us (9611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463313.310708:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788463313.311174:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788463313.311193:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189153d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485728768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463313.311299:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189153d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485728768:12345-0@lo:400:kworker.0 Request processed in 115us (10131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463313.311306:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788463313.318657:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485728640:0@lo:400:kworker.0 00000100:00100000:2.0:1788463313.318686:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485729152:0@lo:400:kworker.0 00000100:00100000:2.0:1788463313.318702:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485729664:0@lo:400:kworker.0 00000100:00100000:2.0:1788463313.318719:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485728768:0@lo:400:kworker.0 00010000:00080000:2.0:1788463313.318738:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f2a00 x1875339485729280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463313.318750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485729280:0@lo:400:kworker.0 00010000:00080000:2.0:1788463313.318764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32300 x1875339485729792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463313.318773:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485729792:0@lo:400:kworker.0 00000100:00080000:2.0:1788463313.318842:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463313.318850:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463313.318879:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463313.319052:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485729024:0@lo:400:kworker.0 00010000:00080000:1.0:1788463313.319070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96189162a680 x1875339485729536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463313.319080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485729536:0@lo:400:kworker.0 00000100:00100000:1.0:1788463313.319093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485728896:0@lo:400:kworker.0 00010000:00080000:1.0:1788463313.319107:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f2d80 x1875339485729408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463313.319114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485729408:0@lo:400:kworker.0 00010000:00010000:1.0:1788463313.546759:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463313.796882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485729920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463313.797011:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463313.797252:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485729920 00000100:00100000:1.0:1788463313.797261:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485729920 00000100:00100000:1.0:1788463313.797314:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463313.797324:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485729920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463313.797358:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463313.797412:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485729920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463313.797420:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788463313.797815:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485729920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463314.308904:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485730048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463314.308981:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463314.309116:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730048 00000100:00100000:1.0:1788463314.309126:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730048 00000100:00100000:1.0:1788463314.309177:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463314.309195:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485730048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463314.309233:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463314.325786:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485730048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 16583us (16793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463314.325812:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788463314.326336:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485730048:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463314.563772:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463315.590694:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463315.696007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463315.696055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463315.696101:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463315.696132:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466778880 00000100:00100000:1.0:1788463315.696143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466778880 00000100:00100000:1.0:1788463315.696208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 290 00000100:00100000:1.0:1788463315.696220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466778880:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463315.696292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466778880:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463315.696300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 290 00000100:00100000:2.0:1788463315.697756:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779136 00000100:00100000:2.0:1788463315.697767:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779136 00000100:00100000:2.0:1788463315.697859:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779008 00000100:00100000:2.0:1788463315.697863:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779008 00000100:00100000:2.0:1788463315.697892:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:2.0:1788463315.697902:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466779136:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463315.697962:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466779136:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 61us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463315.697969:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:2.0:1788463315.697984:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:2.0:1788463315.697991:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466779008:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463315.698016:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466779008:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463315.698022:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00080000:0.0:1788463315.698138:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463315.698143:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788463316.620934:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463316.867804:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463316.867828:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485730176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463316.867915:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463316.870948:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730176 00000100:00100000:3.0:1788463316.870981:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730176 00000100:00100000:0.0:1788463316.876650:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463316.876665:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485730176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463316.876704:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463316.876790:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485730176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463316.876796:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788463316.877031:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec3100 x1875339485730176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463316.877052:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485730176:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788463316.877213:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463317.380553:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485730304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463317.380655:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463317.380842:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730304 00000100:00100000:1.0:1788463317.380851:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730304 00000100:00100000:1.0:1788463317.380919:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788463317.380928:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485730304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463317.380952:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463317.380996:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485730304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463317.381004:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788463317.381094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec2a00 x1875339485730304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463317.381112:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485730304:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463317.381251:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463317.635952:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463318.404155:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485730560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463318.404236:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.404320:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463318.404327:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485730432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463318.404355:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463318.404531:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730560 00000100:00100000:0.0:1788463318.404540:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730560 00000100:00100000:0.0:1788463318.404627:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730432 00000100:00100000:0.0:1788463318.404644:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730432 00000100:00100000:0.0:1788463318.404668:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463318.404677:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485730560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463318.404706:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463318.404760:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485730560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463318.404767:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463318.404783:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463318.404789:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485730432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463318.404798:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463318.404836:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485730432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463318.404842:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788463318.404879:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5e680 x1875339485730432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463318.404907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485730432:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788463318.404918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e02a00 x1875339485730560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463318.404928:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485730560:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788463318.405364:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463318.405714:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485730688:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.405761:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463318.405926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730688 00000100:00100000:1.0:1788463318.405933:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730688 00000100:00100000:1.0:1788463318.405976:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788463318.405984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485730688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.406264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485730688:12345-0@lo:400:kworker.0 Request processed in 279us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.406271:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788463318.406846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485730944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.406887:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.406929:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485731456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.406968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.406987:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.407038:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463318.407045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485731072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.407080:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485731584:0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407101:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.407143:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731456 00000100:00100000:2.0:1788463318.407148:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731456 00000100:00100000:2.0:1788463318.407187:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731968 00000100:00100000:2.0:1788463318.407190:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731968 00000100:00100000:2.0:1788463318.407206:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731072 00000100:00100000:2.0:1788463318.407209:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731072 00000100:00100000:2.0:1788463318.407223:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788463318.407231:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485731456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407272:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485731456:12345-0@lo:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.407280:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788463318.407294:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788463318.407301:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485731968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407328:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485731968:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.407334:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788463318.407345:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463318.407352:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485731072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.407390:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485731072:12345-0@lo:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.407396:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788463318.407412:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463318.407440:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485731072:0@lo:400:kworker.0 00010000:00080000:2.0:1788463318.407453:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787148a80 x1875339485731456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463318.407463:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485731456:0@lo:400:kworker.0 00010000:00080000:2.0:1788463318.407472:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dad180 x1875339485731968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463318.407479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485731968:0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.408015:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730944 00000100:00100000:1.0:1788463318.408021:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730944 00000100:00100000:1.0:1788463318.408060:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463318.408067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485730944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.408125:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485730944:12345-0@lo:400:kworker.0 Request processed in 58us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.408132:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463318.408158:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731584 00000100:00100000:1.0:1788463318.408162:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731584 00000100:00100000:1.0:1788463318.408193:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463318.408200:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485731584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.408231:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485731584:12345-0@lo:400:kworker.0 Request processed in 31us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.408237:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788463318.408251:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463318.408271:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787149880 x1875339485731584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463318.408281:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485731584:0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.408291:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485730944:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485731200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408562:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.408629:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485731712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.408678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485730688:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788463318.408700:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485730816:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408723:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.408742:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485731328:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.408779:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485731840:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.408800:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.409079:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731712 00000100:00100000:2.0:1788463318.409085:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731712 00000100:00100000:1.0:1788463318.409189:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731200 00000100:00100000:1.0:1788463318.409193:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731200 00000100:00100000:1.0:1788463318.409220:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463318.409228:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485731200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463318.409277:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485731200:12345-0@lo:400:kworker.0 Request processed in 50us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.409284:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788463318.409344:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485731200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.409368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485730816 00000100:00100000:3.0:1788463318.409372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485730816 00000100:00100000:3.0:1788463318.409402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731328 00000100:00100000:3.0:1788463318.409406:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731328 00000100:00100000:3.0:1788463318.409427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485731840 00000100:00100000:3.0:1788463318.409430:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485731840 00000100:00100000:3.0:1788463318.409444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788463318.409451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485730816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.409487:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485730816:12345-0@lo:400:kworker.0 Request processed in 37us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463318.409504:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788463318.409518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788463318.409535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485731328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.409567:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485731328:12345-0@lo:400:kworker.0 Request processed in 45us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463318.409592:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788463318.409603:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788463318.409609:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.409711:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463318.409720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463318.409754:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485731712:12345-0@lo:400:kworker.0 Request processed in 37us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.409760:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788463318.410781:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463318.411295:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485731840:12345-0@lo:400:kworker.0 Request processed in 1685us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463318.411303:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788463318.411351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485730816:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.411362:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485731328:0@lo:400:kworker.0 00000100:00100000:3.0:1788463318.411372:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485731840:0@lo:400:kworker.0 00010000:00080000:3.0:1788463318.411385:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dae300 x1875339485731712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463318.411395:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485731712:0@lo:400:kworker.0 00010000:00010000:0.0:1788463318.660917:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463318.928176:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485732096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463318.928253:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463318.940190:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732096 00000100:00100000:2.0:1788463318.940207:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732096 00000100:00100000:2.0:1788463318.940269:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463318.940280:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485732096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463318.940328:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463318.940409:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485732096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (12156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.940417:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463318.940480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485732096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463319.429078:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463319.429104:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485732224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463319.429181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463319.429306:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732224 00000100:00100000:3.0:1788463319.429314:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732224 00000100:00100000:3.0:1788463319.429371:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788463319.429381:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485732224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463319.429416:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463319.429463:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485732224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463319.429483:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463319.429633:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485732224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463319.684781:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463320.707918:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463320.813999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463320.814053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463320.814091:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463320.814136:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779392 00000100:00100000:0.0:1788463320.814159:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779392 00000100:00100000:0.0:1788463320.814239:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779520 00000100:00100000:0.0:1788463320.814242:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779520 00000100:00100000:0.0:1788463320.814273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:0.0:1788463320.814286:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466779392:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463320.814388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466779392:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 104us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463320.814395:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:0.0:1788463320.814415:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:0.0:1788463320.814421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466779520:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463320.814448:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466779520:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463320.814454:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00080000:0.0:1788463320.814471:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463320.814488:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463320.815905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779264 00000100:00100000:3.0:1788463320.815922:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779264 00000100:00100000:3.0:1788463320.816002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 292 00000100:00100000:3.0:1788463320.816013:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2403:x1875339466779264:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463320.816087:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2403:x1875339466779264:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 76us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.816095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 292 00010000:00010000:0.0:1788463321.731723:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463321.989382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463321.989406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485732352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463321.989500:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463321.989570:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732352 00000100:00100000:3.0:1788463321.989596:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732352 00000100:00100000:3.0:1788463321.989655:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463321.989665:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485732352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463321.989695:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463321.989740:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485732352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.989746:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788463321.989767:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463321.989799:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5f100 x1875339485732352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463321.989817:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485732352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463322.500363:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463322.500387:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485732480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463322.500486:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463322.500716:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732480 00000100:00100000:0.0:1788463322.500726:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732480 00000100:00100000:0.0:1788463322.500800:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788463322.500811:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485732480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463322.500845:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463322.500896:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485732480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463322.500903:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788463322.500972:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec0e00 x1875339485732480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463322.500993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485732480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463322.501840:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463322.755863:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463323.523911:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463323.523935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485732608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463323.523940:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463323.523948:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485732736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463323.524149:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485733120:0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.524401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485733248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.526207:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.526289:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485732992:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.526327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.526349:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485733504:0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.526349:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.526372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463323.526372:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485733632:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.526395:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485734016:0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.526395:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463323.526410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485734144:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.526415:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463323.526439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.526464:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732992 00000100:00100000:1.0:1788463323.526464:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733120 00000100:00100000:2.0:1788463323.526470:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732992 00000100:00100000:1.0:1788463323.526470:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733120 00000100:00100000:2.0:1788463323.526504:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733504 00000100:00100000:2.0:1788463323.526506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733504 00000100:00100000:1.0:1788463323.526511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463323.526519:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485733120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.526527:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733632 00000100:00100000:2.0:1788463323.526529:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733632 00000100:00100000:2.0:1788463323.526540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734016 00000100:00100000:2.0:1788463323.526542:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734016 00000100:00100000:2.0:1788463323.526557:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734144 00000100:00100000:2.0:1788463323.526560:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734144 00000100:00100000:1.0:1788463323.526608:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485733120:12345-0@lo:400:kworker.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.526615:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463323.526641:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788463323.526648:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485732992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.526680:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485732992:12345-0@lo:400:kworker.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.526704:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788463323.526720:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463323.526726:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.526754:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485733504:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.526760:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463323.526770:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788463323.526776:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.526972:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485733632:12345-0@lo:400:kworker.0 Request processed in 196us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.526978:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788463323.526992:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463323.526999:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485734016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.527020:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788463323.527024:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485734016:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.527027:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.527030:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788463323.527068:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485734144:12345-0@lo:400:kworker.0 Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.527077:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485733120:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.527081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:1.0:1788463323.527090:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dafb80 x1875339485733632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463323.527099:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463323.527100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485733632:0@lo:400:kworker.0 00000100:00080000:2.0:1788463323.527103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788463323.527109:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dad880 x1875339485734144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463323.527117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485734144:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.527118:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485732992:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.527126:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485733504:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.527134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485734016:0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.527164:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732608 00000100:00100000:1.0:1788463323.527168:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732608 00000100:00080000:2.0:1788463323.527191:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463323.527197:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463323.527203:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485732608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463323.527226:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463323.527271:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485732608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.527278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788463323.527313:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e02a00 x1875339485732608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463323.527329:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485732608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463323.529643:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.529718:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485732864:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.529737:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732736 00000100:00100000:2.0:1788463323.529745:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732736 00000100:00100000:3.0:1788463323.529760:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.529779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485733376:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.529796:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463323.529805:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485732736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463323.529825:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463323.529866:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485732736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.529872:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788463323.529941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.529969:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485733888:0@lo:400:kworker.0 00000100:00100000:3.0:1788463323.529993:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.530009:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485734400:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.530026:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733376 00000100:00100000:3.0:1788463323.530029:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.530030:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733376 00010000:00080000:3.0:1788463323.530059:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5e680 x1875339485732736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463323.530062:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463323.530070:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485733376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463323.530086:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485732736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463323.530101:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485733376:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.530108:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485733376:0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.530122:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788463323.530129:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733888 00000100:00100000:3.0:1788463323.530132:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733888 00000100:00100000:3.0:1788463323.530153:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734400 00000100:00100000:3.0:1788463323.530156:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734400 00000100:00100000:2.0:1788463323.530161:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463323.530168:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485733888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463323.530173:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463323.530178:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463323.530201:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485734400:12345-0@lo:400:kworker.0 Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.530202:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485733888:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.530208:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788463323.530215:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788463323.530237:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dadc00 x1875339485733888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463323.530246:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485733888:0@lo:400:kworker.0 00010000:00080000:3.0:1788463323.530254:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dae680 x1875339485734400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463323.530261:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485734400:0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.531135:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485732864 00000100:00100000:1.0:1788463323.531142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485732864 00000100:00100000:1.0:1788463323.533143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788463323.533164:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485732864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.533255:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485732864:12345-0@lo:400:kworker.0 Request processed in 100us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.533262:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1788463323.533307:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463323.534718:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485732864:0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.534812:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463323.534859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485733760:0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.534895:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463323.534921:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485734272:0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.534942:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463323.534982:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733760 00000100:00100000:0.0:1788463323.534988:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733760 00000100:00100000:0.0:1788463323.535037:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734272 00000100:00100000:0.0:1788463323.535041:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734272 00000100:00100000:0.0:1788463323.535061:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788463323.535135:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463323.535177:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485733760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.535227:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485733760:12345-0@lo:400:kworker.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.536289:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463323.536308:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485734272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463323.536353:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485734272:12345-0@lo:400:kworker.0 Request processed in 55us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.536360:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463323.539467:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485733248 00000100:00100000:1.0:1788463323.539481:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485733248 00000100:00100000:1.0:1788463323.539559:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463323.539611:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463323.539698:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485733248:12345-0@lo:400:kworker.0 Request processed in 91us (4886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.539706:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463323.539780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485733248:0@lo:400:kworker.0 00010000:00080000:1.0:1788463323.539810:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787daca80 x1875339485733760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463323.539840:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485733760:0@lo:400:kworker.0 00010000:00080000:1.0:1788463323.539855:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dac700 x1875339485734272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463323.539864:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485734272:0@lo:400:kworker.0 00000100:00100000:0.0:1788463323.551817:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1788463323.780279:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463324.035986:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463324.036021:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463324.036095:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463324.038698:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734528 00000100:00100000:3.0:1788463324.038717:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734528 00000100:00100000:3.0:1788463324.038799:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463324.038811:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485734528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463324.038855:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463324.038968:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485734528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 159us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463324.038974:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788463324.039099:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463324.548115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463324.548141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485734656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463324.548215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463324.553428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734656 00000100:00100000:1.0:1788463324.554400:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734656 00000100:00100000:1.0:1788463324.554546:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788463324.554558:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485734656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463324.554629:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463324.554716:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485734656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (6501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463324.554723:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788463324.554874:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485734656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463324.804842:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463325.457788:0:12005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:22:04 (1788463324) === 00010000:00010000:0.0:1788463325.827918:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463325.934267:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463325.934316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463325.934347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463325.934423:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779904 00000100:00100000:2.0:1788463325.934443:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779904 00000100:00100000:1.0:1788463325.934510:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779648 00000100:00100000:1.0:1788463325.934523:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779648 00000100:00100000:2.0:1788463325.934543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466779776 00000100:00100000:2.0:1788463325.934549:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466779776 00000100:00100000:2.0:1788463325.934642:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:1.0:1788463325.934653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 294 00000100:00100000:2.0:1788463325.934664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466779904:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463325.934673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466779648:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463325.934765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466779648:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 100us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463325.934799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:3.0:1788463325.934813:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466779776:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:0.0:1788463325.934998:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463325.935005:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463325.935295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 294 00000100:00100000:2.0:1788463325.936657:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466779904:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1991us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463325.936672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:1.0:1788463325.936862:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466779776:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 2051us (2511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.936871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:1.0:1788463325.954205:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463325.955821:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780032 00000100:00100000:3.0:1788463325.955835:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780032 00000100:00100000:3.0:1788463325.955905:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 295 00000100:00100000:3.0:1788463325.955916:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:8744:x1875339466780032:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463325.955933:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463325.955951:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880031e00/0x841acb7f42a39822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476603 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463325.955998:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880031e00/0x841acb7f42a39822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476603 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463325.956010:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880031e00/0x841acb7f42a39822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476603 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463325.956020:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031e00, rc 0) 00000100:00100000:3.0:1788463325.956089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780032:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 174us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463325.956096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 295 00000100:00100000:0.0:1788463325.960155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463325.960278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780160 00000100:00100000:1.0:1788463325.960292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780160 00000100:00100000:1.0:1788463325.960366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 296 00000100:00100000:1.0:1788463325.960389:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780160:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788463325.960657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780160:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 280us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.960785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 296 00000100:00100000:2.0:1788463325.968829:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463325.969218:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780288 00000100:00100000:0.0:1788463325.969233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780288 00000100:00100000:0.0:1788463325.969310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 297 00000100:00100000:0.0:1788463325.969324:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780288:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463325.969544:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780288:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 222us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463325.969554:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 297 00000100:00100000:2.0:1788463325.975658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463325.975987:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780416 00000100:00100000:1.0:1788463325.976002:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780416 00000100:00100000:1.0:1788463325.976084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 298 00000100:00100000:1.0:1788463325.976096:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780416:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463325.976465:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780416:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 369us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.976474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 298 00000100:00100000:1.0:1788463326.005647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.012042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780544 00000100:00100000:3.0:1788463326.012068:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780544 00000100:00100000:3.0:1788463326.012168:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 299 00000100:00100000:3.0:1788463326.012181:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780544:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463326.012426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780544:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 246us (6794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.012434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 299 00000100:00100000:2.0:1788463326.019623:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.020097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780672 00000100:00100000:1.0:1788463326.020193:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780672 00000100:00100000:1.0:1788463326.020276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 300 00000100:00100000:1.0:1788463326.020288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780672:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463326.020515:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8748:x1875339466780672:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 229us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.020524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 300 00000100:00100000:2.0:1788463326.025312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463326.025511:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780800 00000100:00100000:0.0:1788463326.025525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780800 00000100:00100000:0.0:1788463326.025632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 301 00000100:00100000:0.0:1788463326.025644:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:8744:x1875339466780800:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463326.025678:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463326.025703:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476634 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463326.025892:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476634 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463326.025909:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476634 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463326.025920:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4000, rc 0) 00000100:00100000:0.0:1788463326.025995:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:8744:x1875339466780800:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 353us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.026003:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 301 00000100:00100000:0.0:1788463326.029075:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.029400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466780928 00000100:00100000:3.0:1788463326.029414:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466780928 00000100:00100000:3.0:1788463326.029483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 302 00000100:00100000:3.0:1788463326.029494:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:8744:x1875339466780928:12345-192.168.204.53@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788463326.029530:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788463326.029561:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788463326.029565:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788463326.029569:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788463326.029618:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788463326.029628:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788463326.032483:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:8744:x1875339466780928:12345-192.168.204.53@tcp:256:mount.lustre.0 Request processed in 2973us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.032501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 302 00000100:00100000:2.0:1788463326.036229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.036496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781056 00000100:00100000:1.0:1788463326.036511:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781056 00000100:00100000:1.0:1788463326.036617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 303 00000100:00100000:1.0:1788463326.036646:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:8744:x1875339466781056:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788463326.036680:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463326.036703:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47663b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463326.036809:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463326.036825:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463326.036897:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0cc00, rc 0) 00000100:00100000:1.0:1788463326.036982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8744:x1875339466781056:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 337us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.036989:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 303 00000100:00100000:0.0:1788463326.039651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.039866:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781184 00000100:00100000:3.0:1788463326.039878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781184 00000100:00100000:3.0:1788463326.039951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 304 00000100:00100000:3.0:1788463326.039963:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8744:x1875339466781184:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788463326.040187:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8744:x1875339466781184:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 225us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.040196:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 304 00000100:00100000:2.0:1788463326.043801:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463326.043971:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781312 00000100:00100000:0.0:1788463326.043986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781312 00000100:00100000:0.0:1788463326.044058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 305 00000100:00100000:0.0:1788463326.044070:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8744:x1875339466781312:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463326.044352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8744:x1875339466781312:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 283us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.044362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 305 00000100:00100000:2.0:1788463326.053802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.054687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781440 00000100:00100000:1.0:1788463326.054704:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781440 00000100:00100000:1.0:1788463326.054788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 306 00000100:00100000:1.0:1788463326.054801:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8753:x1875339466781440:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463326.055089:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8753:x1875339466781440:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 289us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.055098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 306 00000100:00100000:1.0:1788463326.062678:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.063184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781568 00000100:00100000:3.0:1788463326.063199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781568 00000100:00100000:3.0:1788463326.063275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 307 00000100:00100000:3.0:1788463326.063287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8753:x1875339466781568:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463326.063502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:8753:x1875339466781568:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 216us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.063512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 307 00000100:00100000:2.0:1788463326.068482:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463326.068537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.068664:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781696 00000100:00100000:1.0:1788463326.068678:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781696 00000100:00100000:1.0:1788463326.068732:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781952 00000100:00100000:1.0:1788463326.068735:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781952 00000100:00100000:1.0:1788463326.068786:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:1.0:1788463326.068796:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875339466781696:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788463326.068850:0:10067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d@192.168.204.53@tcp t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:1.0:1788463326.068910:0:10067:0:(genops.c:1385:class_connect()) connect: client 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d, cookie 0x841acb7f42a39837 00000004:00100000:1.0:1788463326.068943:0:10067:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788463326.069116:0:10067:0:(import.c:65:import_set_state_nolock()) ffff9618c1ad0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463326.069208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:1.0:1788463326.069216:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2399:x1875339466781696:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 418us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.069221:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466781952:12345-192.168.204.53@tcp:38:mount.lustre.0 00000100:00100000:1.0:1788463326.069231:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00010000:00080000:0.0:1788463326.069247:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d@192.168.204.53@tcp t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:0.0:1788463326.069295:0:6524:0:(genops.c:1385:class_connect()) connect: client 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d, cookie 0x841acb7f42a3983e 00000004:00100000:0.0:1788463326.069311:0:6524:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788463326.069819:0:6524:0:(import.c:65:import_set_state_nolock()) ffff961787257000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463326.069917:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2399:x1875339466781952:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 696us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.069930:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:2.0:1788463326.084507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463326.084552:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463326.084609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463326.084642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466781824 00000100:00100000:2.0:1788463326.084656:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466781824 00000100:00100000:2.0:1788463326.084745:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782208 00000100:00100000:2.0:1788463326.084749:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782208 00000100:00100000:2.0:1788463326.084768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782080 00000100:00100000:2.0:1788463326.084770:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782080 00000100:00100000:2.0:1788463326.084793:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463326.084806:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+7:0:x1875339466781824:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463326.084862:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463326.084989:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+7:0:x1875339466781824:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 185us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463326.084999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463326.085023:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463326.085032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782208:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463326.085045:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463326.085070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782208:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463326.085098:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463326.085125:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:2.0:1788463326.085133:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:0:x1875339466782080:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788463326.085152:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463326.085194:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:0:x1875339466782080:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 62us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463326.085201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00080000:2.0:1788463326.085222:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463326.085227:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463326.092656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.092717:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782336 00000100:00100000:1.0:1788463326.092730:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782336 00000100:00100000:1.0:1788463326.092799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:1.0:1788463326.092812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782336:12345-192.168.204.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788463326.092945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782336:12345-192.168.204.53@tcp:40:mount.lustre.0 Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.092953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:1.0:1788463326.098780:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.099060:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782464 00000100:00100000:3.0:1788463326.099075:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782464 00000100:00100000:3.0:1788463326.099141:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463326.099152:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2399:x1875339466782464:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463326.099199:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d@192.168.204.53@tcp t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:3.0:1788463326.099237:0:8440:0:(genops.c:1385:class_connect()) connect: client 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d, cookie 0x841acb7f42a39845 00002000:00100000:3.0:1788463326.099254:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d/ffff961787d21800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463326.099299:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463326.099417:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463326.099457:0:8440:0:(import.c:65:import_set_state_nolock()) ffff961787d20800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463326.099548:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2399:x1875339466782464:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 396us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.099558:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463326.099655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.099765:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463326.099787:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782720 00000100:00100000:3.0:1788463326.099792:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782720 00000100:00100000:3.0:1788463326.099830:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:3.0:1788463326.099837:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782720:12345-192.168.204.53@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788463326.099882:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782720:12345-192.168.204.53@tcp:900:mount.lustre.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.099889:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:3.0:1788463326.099907:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782592 00000100:00100000:3.0:1788463326.099910:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782592 00000100:00100000:3.0:1788463326.099927:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463326.099932:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466782592:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463326.099952:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d@192.168.204.53@tcp t0 exp 0000000000000000 cur 365 last 0 00000020:00000080:3.0:1788463326.099975:0:8441:0:(genops.c:1385:class_connect()) connect: client 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d, cookie 0x841acb7f42a3984c 00002000:00100000:3.0:1788463326.099987:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d/ffff961787d25800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463326.100002:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463326.100051:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788463326.100071:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787d23000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463326.100108:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2399:x1875339466782592:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 173us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.100116:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463326.102510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463326.102949:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782848 00000100:00100000:1.0:1788463326.102962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782848 00000100:00100000:1.0:1788463326.103062:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:1.0:1788463326.103092:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782848:12345-192.168.204.53@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788463326.103452:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788463326.103845:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:8744:x1875339466782848:12345-192.168.204.53@tcp:33:mount.lustre.0 Request processed in 756us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.104128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00010000:00010000:1.0:1788463326.852685:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463327.109419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485734784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463327.109526:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463327.109646:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734784 00000100:00100000:3.0:1788463327.109656:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734784 00000100:00100000:3.0:1788463327.110253:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463327.110267:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485734784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463327.110301:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463327.110381:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485734784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463327.110390:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788463327.110426:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463327.110463:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5e680 x1875339485734784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463327.110487:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485734784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463327.620190:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485734912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463327.620288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463327.620396:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485734912 00000100:00100000:3.0:1788463327.620405:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485734912 00000100:00100000:3.0:1788463327.620494:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463327.620503:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485734912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463327.620542:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788463327.620603:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463327.620619:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485734912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463327.620637:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788463327.620691:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf30700 x1875339485734912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463327.620713:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485734912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463327.876041:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463328.644537:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485735040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463328.644628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.644699:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735040 00000100:00100000:1.0:1788463328.644708:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735040 00000100:00100000:1.0:1788463328.644765:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788463328.644774:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c004a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485735040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463328.644807:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463328.644850:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c004a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485735040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.644857:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788463328.645062:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463328.645094:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700c000 x1875339485735040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.645112:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485735040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463328.645692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463328.645729:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.645765:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735168 00000100:00100000:1.0:1788463328.645770:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735168 00000100:00100000:1.0:1788463328.645801:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463328.645809:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485735168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463328.645821:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463328.645850:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485735168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.645855:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788463328.645870:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463328.645896:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787dad880 x1875339485735168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.645908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463328.646092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485735296:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646124:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646146:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485735808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646167:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646183:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646205:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646225:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788463328.646230:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485735424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646252:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646269:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485735936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646303:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485736448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735296 00000100:00100000:1.0:1788463328.646363:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735296 00000100:00100000:1.0:1788463328.646390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788463328.646397:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485735296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646428:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485735296:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788463328.646457:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735808 00000100:00100000:1.0:1788463328.646461:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735808 00000100:00100000:1.0:1788463328.646511:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788463328.646517:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646548:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485735808:12345-0@lo:400:kworker.0 Request processed in 32us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646554:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788463328.646570:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735424 00000100:00100000:1.0:1788463328.646591:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735424 00000100:00100000:3.0:1788463328.646598:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736320 00000100:00100000:3.0:1788463328.646603:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736320 00000100:00100000:1.0:1788463328.646613:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735936 00000100:00100000:1.0:1788463328.646615:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735936 00000100:00100000:1.0:1788463328.646631:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736448 00000100:00100000:1.0:1788463328.646634:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736448 00000100:00100000:1.0:1788463328.646651:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788463328.646656:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485735424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646685:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485735424:12345-0@lo:400:kworker.0 Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646692:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788463328.646704:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788463328.646710:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646734:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485735936:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463328.646739:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463328.646740:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788463328.646745:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485736320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646750:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788463328.646755:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485736448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463328.646775:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485736320:12345-0@lo:400:kworker.0 Request processed in 32us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646775:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485736448:12345-0@lo:400:kworker.0 Request processed in 20us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646781:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1788463328.646801:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463328.646816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485735680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646839:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463328.646854:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463328.646856:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485736192:0@lo:400:kworker.0 00000100:00100000:3.0:1788463328.646873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735680 00000100:00100000:1.0:1788463328.646875:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463328.646877:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735680 00000100:00100000:1.0:1788463328.646891:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788463328.646895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463328.646897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485735552:0@lo:400:kworker.0 00000100:00100000:3.0:1788463328.646901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485735680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463328.646926:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485735680:12345-0@lo:400:kworker.0 Request processed in 25us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.646930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485736064:0@lo:400:kworker.0 00000100:00100000:3.0:1788463328.646932:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463328.646966:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.646980:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485736576:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.646999:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463328.647024:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485735680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647045:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485735552 00000100:00100000:1.0:1788463328.647048:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485735552 00000100:00100000:1.0:1788463328.647071:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788463328.647077:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485735552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647109:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485735552:12345-0@lo:400:kworker.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.647114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788463328.647128:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736064 00000100:00100000:1.0:1788463328.647131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736064 00000100:00100000:1.0:1788463328.647148:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736576 00000100:00100000:1.0:1788463328.647151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736576 00000100:00100000:1.0:1788463328.647163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788463328.647167:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485736064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647192:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485736064:12345-0@lo:400:kworker.0 Request processed in 24us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.647206:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788463328.647220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463328.647226:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485736576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485736576:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463328.647259:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788463328.647275:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463328.647298:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485735424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647308:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485735936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647317:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485736448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647338:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485735296:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647348:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485735808:0@lo:400:kworker.0 00010000:00080000:1.0:1788463328.647360:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da4e00 x1875339485736320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.647368:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485736320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463328.647400:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485735552:0@lo:400:kworker.0 00010000:00080000:1.0:1788463328.647411:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5880 x1875339485736064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.647420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485736064:0@lo:400:kworker.0 00010000:00080000:1.0:1788463328.647429:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da7100 x1875339485736576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.647448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485736576:0@lo:400:kworker.0 00000100:00100000:0.0:1788463328.649720:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736192 00000100:00100000:0.0:1788463328.649736:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736192 00000100:00100000:0.0:1788463328.649796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463328.649806:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485736192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463328.649890:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485736192:12345-0@lo:400:kworker.0 Request processed in 86us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463328.649907:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788463328.650032:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da4380 x1875339485736192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463328.650046:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485736192:0@lo:400:kworker.0 00010000:00010000:1.0:1788463328.901279:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463329.156943:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463329.156967:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463329.157036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463329.157138:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736704 00000100:00100000:0.0:1788463329.157146:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736704 00000100:00100000:0.0:1788463329.157198:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788463329.157207:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485736704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463329.157241:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463329.157289:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485736704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463329.157298:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463329.157384:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463329.669966:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463329.669989:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485736832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463329.670058:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463329.670126:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736832 00000100:00100000:2.0:1788463329.670133:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736832 00000100:00100000:2.0:1788463329.670173:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463329.670182:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485736832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463329.670213:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463329.670270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485736832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463329.670277:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463329.670331:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485736832:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463329.924134:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463330.948029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463331.569075:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463331.569118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463331.569151:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463331.569161:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466782976 00000100:00100000:1.0:1788463331.569172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466782976 00000100:00100000:2.0:1788463331.569189:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463331.569231:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 309 00000100:00100000:2.0:1788463331.569240:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463331.569245:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466782976:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463331.569281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463331.569323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466782976:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463331.569332:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 309 00000100:00100000:3.0:1788463331.569351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783232 00000100:00100000:3.0:1788463331.569369:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783232 00000100:00100000:1.0:1788463331.569374:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783488 00000100:00100000:1.0:1788463331.569380:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783488 00000100:00100000:0.0:1788463331.569450:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783104 00000100:00100000:0.0:1788463331.569455:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783104 00000100:00100000:3.0:1788463331.569497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783360 00000100:00100000:3.0:1788463331.569507:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783360 00000100:00100000:1.0:1788463331.570351:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:1.0:1788463331.570360:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466783232:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463331.570908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 156 00000100:00100000:0.0:1788463331.570917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783488:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463331.573999:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788463331.574014:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788463331.574419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463331.574530:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783744 00000100:00100000:2.0:1788463331.574540:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783744 00000100:00100000:2.0:1788463331.574594:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783616 00000100:00100000:2.0:1788463331.574597:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783616 00000100:00100000:2.0:1788463331.574625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463331.574638:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783744:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463331.574701:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783744:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 67us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463331.574707:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463331.574724:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:2.0:1788463331.574731:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783616:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463331.574756:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783616:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463331.574762:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:2.0:1788463331.575050:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 157 00000100:00100000:2.0:1788463331.575061:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466783104:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463331.575091:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466783104:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463331.575098:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 157 00000100:00100000:2.0:1788463331.575112:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788463331.575118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 158 00000100:00100000:2.0:1788463331.575125:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783360:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463331.575166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783360:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 42us (5886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463331.575172:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 158 00000100:00100000:1.0:1788463331.575417:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466783232:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 5055us (6296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463331.575427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00080000:1.0:1788463331.575455:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463331.575460:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463331.575463:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463331.575466:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463331.577500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466783488:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 6573us (8338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463331.577514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 156 00000001:00100000:3.0:1788463331.718085:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00100000:2.0:1788463331.721529:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00100000:3.0:1788463331.722739:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00100000:2.0:1788463331.724405:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00010000:00010000:1.0:1788463331.971816:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463332.230787:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485736960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463332.231959:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463332.232363:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485736960 00000100:00100000:2.0:1788463332.232373:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485736960 00000100:00100000:2.0:1788463332.232428:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463332.232440:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485736960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463332.232470:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463332.232519:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485736960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.232527:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788463332.232593:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700d500 x1875339485736960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463332.232614:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485736960:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788463332.235007:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788463332.536007:0:12199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788463332.749856:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485737088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463332.749932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463332.750028:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737088 00000100:00100000:2.0:1788463332.750037:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737088 00000100:00100000:2.0:1788463332.750108:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463332.750118:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485737088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463332.750142:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463332.757674:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485737088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7546us (7729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.757690:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788463332.757735:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463332.757877:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da4a80 x1875339485737088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463332.757903:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485737088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463332.999394:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463333.764304:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485737600:0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.764343:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485737216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.764379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.764379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463333.765765:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485737472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.767686:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485738112:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.767741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.767793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485738624:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.767815:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.768174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737600 00000100:00100000:0.0:1788463333.768183:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737600 00000100:00100000:0.0:1788463333.768242:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463333.768252:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485737600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.768390:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485737600:12345-0@lo:400:kworker.0 Request processed in 139us (4010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463333.768398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463333.768538:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738112 00000100:00100000:0.0:1788463333.768543:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738112 00000100:00100000:0.0:1788463333.768568:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738624 00000100:00100000:0.0:1788463333.768571:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738624 00000100:00100000:0.0:1788463333.768610:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463333.768613:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485737728:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.768616:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485738112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.768644:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.768647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485738112:12345-0@lo:400:kworker.0 Request processed in 32us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463333.768654:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463333.768664:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485738240:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.768665:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463333.768671:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.768686:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.768695:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485738624:12345-0@lo:400:kworker.0 Request processed in 24us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463333.768696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485738752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.768701:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463333.768710:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738240 00000100:00100000:0.0:1788463333.768713:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738240 00000100:00100000:1.0:1788463333.768716:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463333.768725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738752 00000100:00100000:0.0:1788463333.768727:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738752 00000100:00100000:0.0:1788463333.768740:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463333.768752:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485738240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.768769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737216 00000100:00100000:1.0:1788463333.768773:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737216 00000100:00100000:1.0:1788463333.768802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788463333.768808:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485737216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463333.768844:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485737216:12345-0@lo:400:kworker.0 Request processed in 36us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463333.768850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788463333.769196:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485738240:12345-0@lo:400:kworker.0 Request processed in 442us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463333.769203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463333.769215:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463333.769221:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485738752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.769258:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485738752:12345-0@lo:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463333.769268:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788463333.770560:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463333.770629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485737600:0@lo:400:kworker.0 00010000:00080000:0.0:1788463333.770645:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da5880 x1875339485738112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463333.770656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485738112:0@lo:400:kworker.0 00010000:00080000:0.0:1788463333.770667:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1b100 x1875339485738624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463333.770675:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485738624:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.770739:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737728 00000100:00100000:0.0:1788463333.770745:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737728 00000100:00100000:2.0:1788463333.771030:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463333.771615:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485737216:0@lo:400:kworker.0 00010000:00080000:1.0:1788463333.771633:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da4e00 x1875339485738240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463333.771644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485738240:0@lo:400:kworker.0 00010000:00080000:1.0:1788463333.771654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1bb80 x1875339485738752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463333.771662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485738752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.773410:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737472 00000100:00100000:2.0:1788463333.773630:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485737984:0@lo:400:kworker.0 00000100:00100000:2.0:1788463333.773680:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463333.773697:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485738496:0@lo:400:kworker.0 00000100:00100000:2.0:1788463333.773736:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463333.773762:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485739008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463333.773948:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485737344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.773981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463333.774003:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485737856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774023:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463333.774040:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485738368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774060:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463333.774077:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485738880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463333.774099:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463333.774139:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737984 00000100:00100000:3.0:1788463333.774146:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737984 00000100:00100000:3.0:1788463333.774187:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738496 00000100:00100000:3.0:1788463333.774191:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738496 00000100:00100000:3.0:1788463333.774206:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737344 00000100:00100000:3.0:1788463333.774209:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737344 00000100:00100000:3.0:1788463333.774220:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485737856 00000100:00100000:3.0:1788463333.774233:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737856 00000100:00100000:3.0:1788463333.774259:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738368 00000100:00100000:3.0:1788463333.774263:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738368 00000100:00100000:3.0:1788463333.774277:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788463333.774285:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485737984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774335:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485737984:12345-0@lo:400:kworker.0 Request processed in 51us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774343:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788463333.774359:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463333.774365:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485738496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774392:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485738496:12345-0@lo:400:kworker.0 Request processed in 27us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774398:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463333.774409:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788463333.774415:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485737344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774446:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485737344:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774453:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788463333.774464:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788463333.774469:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485737856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774494:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485737856:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774500:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788463333.774511:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788463333.774516:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485738368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774540:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485738368:12345-0@lo:400:kworker.0 Request processed in 24us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774553:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788463333.774616:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485737344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774627:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485737856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774635:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485738368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774701:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463333.774726:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485737728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.774771:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485737728:12345-0@lo:400:kworker.0 Request processed in 63us (6126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774777:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788463333.774805:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463333.774809:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463333.774818:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485738880 00000100:00100000:3.0:1788463333.774822:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485738880 00000100:00100000:3.0:1788463333.774847:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463333.774853:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485738880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463333.774879:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463333.774915:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485738880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.774922:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788463333.774948:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700d500 x1875339485738880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463333.774962:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485738880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463333.775006:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485737728:0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.776000:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485737472 00000100:00100000:0.0:1788463333.776045:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463333.776054:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485737472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463333.776105:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485737472:12345-0@lo:400:kworker.0 Request processed in 53us (5076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463333.776271:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788463333.776646:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463333.776691:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485737472:0@lo:400:kworker.0 00010000:00080000:2.0:1788463333.776705:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da7100 x1875339485737984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463333.776713:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485737984:0@lo:400:kworker.0 00010000:00080000:2.0:1788463333.776723:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1ad80 x1875339485738496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463333.776730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485738496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463333.776747:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739008 00000100:00100000:3.0:1788463333.776751:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739008 00000100:00100000:3.0:1788463333.776779:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463333.776786:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485739008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463333.776802:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463333.776843:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485739008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463333.776849:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788463333.777105:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c3800 x1875339485739008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463333.777187:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485739008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788463334.030709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463334.276234:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485739136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463334.276333:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463334.276829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739136 00000100:00100000:0.0:1788463334.276838:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739136 00000100:00100000:0.0:1788463334.276892:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463334.276902:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485739136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463334.276937:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463334.276996:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485739136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463334.277003:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463334.277050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485739136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463334.787860:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463334.787883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485739264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463334.787950:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463334.788022:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739264 00000100:00100000:0.0:1788463334.788030:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739264 00000100:00100000:0.0:1788463334.788075:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788463334.788086:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485739264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463334.788134:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463334.788177:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485739264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463334.788184:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788463334.788242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485739264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463335.045922:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463336.069068:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463336.685404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685456:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685628:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463336.685666:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784640 00000100:00100000:0.0:1788463336.685676:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784640 00000100:00100000:1.0:1788463336.685713:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466783872 00000100:00100000:1.0:1788463336.685718:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466783872 00000100:00100000:0.0:1788463336.685728:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784512 00000100:00100000:0.0:1788463336.685730:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784512 00000100:00100000:1.0:1788463336.685747:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 311 00000100:00100000:0.0:1788463336.685747:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:1.0:1788463336.685756:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466783872:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463336.685756:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784640:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463336.685814:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466783872:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 59us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463336.685822:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 311 00000100:00100000:2.0:1788463336.685838:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784128 00000100:00100000:2.0:1788463336.685842:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784128 00000100:00100000:2.0:1788463336.685871:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784384 00000100:00100000:2.0:1788463336.685873:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784384 00000100:00100000:2.0:1788463336.685886:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784000 00000100:00100000:2.0:1788463336.685888:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784000 00000100:00100000:2.0:1788463336.685910:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784256 00000100:00100000:2.0:1788463336.685913:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784256 00000100:00100000:2.0:1788463336.685926:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 165 00000100:00100000:2.0:1788463336.685947:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466784128:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463336.685949:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:1.0:1788463336.685955:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784512:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463336.686021:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 166 00000100:00100000:3.0:1788463336.686031:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784384:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463336.686193:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784640:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 436us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463336.686200:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00080000:0.0:1788463336.686246:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463336.686250:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463336.686253:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463336.686255:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463336.686267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00100000:0.0:1788463336.686274:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466784000:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463336.686301:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466784000:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463336.686307:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00100000:0.0:1788463336.686322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 168 00000100:00100000:0.0:1788463336.686328:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784256:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463336.686350:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784256:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463336.686363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 168 00000100:00100000:2.0:1788463336.687694:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466784128:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1669us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463336.687707:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 165 00000100:00100000:1.0:1788463336.692717:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784512:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 6748us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463336.692734:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:3.0:1788463336.694276:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466784384:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 8237us (8768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463336.694298:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 166 00010000:00010000:0.0:1788463337.091795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463337.348072:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463337.348094:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485739392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463337.348176:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463337.348236:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739392 00000100:00100000:2.0:1788463337.348244:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739392 00000100:00100000:2.0:1788463337.348297:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463337.348309:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485739392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463337.348336:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463337.348379:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485739392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463337.348386:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788463337.348404:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463337.348453:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23100 x1875339485739392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463337.348470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485739392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463337.871057:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463337.871079:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485739520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463337.871163:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463337.876262:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739520 00000100:00100000:2.0:1788463337.876276:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739520 00000100:00100000:2.0:1788463337.876355:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463337.876366:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485739520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463337.876411:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463337.876510:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485739520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (5346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463337.876529:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788463337.876551:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463337.880968:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1b480 x1875339485739520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463337.880998:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485739520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463338.115885:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463338.886220:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463338.886248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485739648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463338.886333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463338.886408:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739648 00000100:00100000:1.0:1788463338.886540:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739648 00000100:00100000:1.0:1788463338.886639:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788463338.886649:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485739648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463338.886682:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463338.886724:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485739648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463338.886731:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788463338.886769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485739776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463338.886800:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788463338.886839:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1f80 x1875339485739648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463338.886857:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485739648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463338.886883:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739776 00000100:00100000:1.0:1788463338.886887:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739776 00000100:00100000:1.0:1788463338.886906:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788463338.886912:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485739776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463338.886922:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463338.886950:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485739776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463338.886956:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788463338.886978:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23100 x1875339485739776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463338.886991:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485739776:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788463338.887085:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463338.892458:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485740032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892528:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892571:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485740544:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892618:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892643:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485741056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892661:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892686:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788463338.892692:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892717:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892737:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485740416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892761:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892796:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485740928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.892821:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.892853:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740032 00000100:00100000:3.0:1788463338.892860:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740032 00000100:00100000:3.0:1788463338.892905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740544 00000100:00100000:3.0:1788463338.892908:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740544 00000100:00100000:3.0:1788463338.892933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741056 00000100:00100000:3.0:1788463338.892936:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741056 00000100:00100000:3.0:1788463338.892951:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788463338.892959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485740032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893009:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485740032:12345-0@lo:400:kworker.0 Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893017:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788463338.893033:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788463338.893039:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485740544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485740544:12345-0@lo:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893072:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788463338.893083:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788463338.893089:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485741056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893117:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485741056:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788463338.893162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485739904 00000100:00100000:3.0:1788463338.893166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485739904 00000100:00100000:3.0:1788463338.893193:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788463338.893199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893239:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485739904:12345-0@lo:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788463338.893288:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740416 00000100:00100000:3.0:1788463338.893292:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740416 00000100:00100000:3.0:1788463338.893317:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463338.893322:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485740416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893353:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485740416:12345-0@lo:400:kworker.0 Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893359:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463338.893377:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740928 00000100:00100000:3.0:1788463338.893380:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740928 00000100:00100000:3.0:1788463338.893406:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463338.893413:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485740928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893441:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485740928:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893447:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788463338.893465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463338.893489:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485740288:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893514:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.893531:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485740800:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893552:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.893603:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788463338.893610:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485740160:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.893650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485740672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893679:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.893696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485741184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463338.893739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740288 00000100:00100000:3.0:1788463338.893742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740288 00000100:00100000:3.0:1788463338.893764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740672 00000100:00100000:3.0:1788463338.893766:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740672 00000100:00100000:3.0:1788463338.893783:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741184 00000100:00100000:3.0:1788463338.893786:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741184 00000100:00100000:3.0:1788463338.893799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788463338.893804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485740288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893838:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485740288:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893844:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788463338.893857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788463338.893863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485740672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485740672:12345-0@lo:400:kworker.0 Request processed in 26us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893894:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788463338.893905:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788463338.893911:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485741184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.893935:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485741184:12345-0@lo:400:kworker.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463338.893940:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788463338.893961:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463338.893989:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.894012:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485740416:0@lo:400:kworker.0 00010000:00080000:3.0:1788463338.894025:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5c000 x1875339485740928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463338.894034:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485740928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.894044:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485740032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.894054:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485740544:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.894063:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485741056:0@lo:400:kworker.0 00010000:00080000:3.0:1788463338.894097:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ce00 x1875339485740672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463338.894104:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485740672:0@lo:400:kworker.0 00010000:00080000:3.0:1788463338.894136:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5df80 x1875339485741184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463338.894145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485741184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463338.894156:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485740288:0@lo:400:kworker.0 00000100:00100000:0.0:1788463338.903769:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740800 00000100:00100000:0.0:1788463338.903790:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740800 00000100:00100000:0.0:1788463338.903866:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463338.903878:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463338.903983:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485740800:12345-0@lo:400:kworker.0 Request processed in 107us (10429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463338.903990:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463338.904017:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485740160 00000100:00100000:0.0:1788463338.904021:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485740160 00000100:00100000:0.0:1788463338.904047:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788463338.904053:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485740160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463338.904088:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485740160:12345-0@lo:400:kworker.0 Request processed in 35us (10453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463338.904094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788463338.904153:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485740160:0@lo:400:kworker.0 00010000:00080000:0.0:1788463338.904170:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ca80 x1875339485740800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463338.904182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485740800:0@lo:400:kworker.0 00010000:00010000:0.0:1788463339.141645:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463339.396034:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463339.396061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485741312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463339.396143:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463339.396546:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741312 00000100:00100000:2.0:1788463339.396554:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741312 00000100:00100000:2.0:1788463339.396639:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788463339.396648:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485741312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463339.396683:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463339.396738:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485741312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463339.396744:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788463339.396867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485741312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463339.908301:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463339.908326:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485741440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463339.908398:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463339.908782:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741440 00000100:00100000:0.0:1788463339.908798:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741440 00000100:00100000:0.0:1788463339.908854:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788463339.908865:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485741440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463339.908899:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463339.908958:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485741440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463339.908969:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788463339.909125:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485741440:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463340.163949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463341.192667:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463341.810416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463341.810656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463341.811063:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784896 00000100:00100000:1.0:1788463341.811084:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784896 00000100:00100000:1.0:1788463341.811158:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785152 00000100:00100000:1.0:1788463341.811162:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785152 00000100:00100000:1.0:1788463341.811180:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785024 00000100:00100000:1.0:1788463341.811183:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785024 00000100:00100000:1.0:1788463341.811195:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785280 00000100:00100000:1.0:1788463341.811198:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785280 00000100:00100000:1.0:1788463341.811216:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:1.0:1788463341.811224:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466784896:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463341.811314:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466784896:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 90us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.811322:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:1.0:1788463341.811341:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 176 00000100:00100000:1.0:1788463341.811347:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785152:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463341.811388:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785152:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.811395:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 176 00000100:00100000:1.0:1788463341.811411:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 177 00000100:00100000:2.0:1788463341.811415:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785408 00000100:00100000:1.0:1788463341.811419:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466785024:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463341.811423:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785408 00000100:00100000:1.0:1788463341.811449:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466785024:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.811456:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 177 00000100:00100000:2.0:1788463341.811464:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785536 00000100:00100000:2.0:1788463341.811469:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785536 00000100:00100000:1.0:1788463341.811473:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 178 00000100:00100000:1.0:1788463341.811482:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785280:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463341.811503:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:1.0:1788463341.811509:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785280:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.811522:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 178 00000100:00100000:2.0:1788463341.811523:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785408:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463341.811559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466784768 00000100:00100000:1.0:1788463341.811564:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466784768 00000100:00100000:2.0:1788463341.811616:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785408:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 102us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.811623:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 313 00000100:00100000:2.0:1788463341.811628:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:1.0:1788463341.811635:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466784768:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463341.811667:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463341.811672:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466784768:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 36us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463341.811682:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785536:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463341.811694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 313 00000100:00100000:2.0:1788463341.811724:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466785536:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 45us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463341.811731:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00080000:0.0:1788463341.812402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463341.812408:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463341.812411:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463341.812413:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463342.211793:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463342.472403:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463342.472426:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485741568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463342.472497:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463342.472623:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741568 00000100:00100000:3.0:1788463342.472631:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741568 00000100:00100000:3.0:1788463342.472689:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463342.472702:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485741568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463342.472734:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463342.472783:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485741568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463342.472790:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788463342.472835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ca80 x1875339485741568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463342.472853:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485741568:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463342.472957:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463342.983636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463342.983660:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485741696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463342.983803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463342.983953:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741696 00000100:00100000:0.0:1788463342.983962:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741696 00000100:00100000:0.0:1788463342.984025:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463342.984034:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485741696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463342.984072:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463342.984131:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485741696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463342.984139:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788463342.984159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463342.985119:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da4700 x1875339485741696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463342.985145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485741696:0@lo:13:osp-pre-0-0.0 00000020:00000004:2.0:1788463343.169209:0:12514:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463343.169920:0:12514:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463343.239225:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463344.003860:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463344.003884:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485741824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463344.003958:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463344.004855:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741824 00000100:00100000:0.0:1788463344.004866:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741824 00000100:00100000:0.0:1788463344.004934:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788463344.004945:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485741824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463344.004974:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463344.005048:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485741824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.005056:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1788463344.005106:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d110a80 x1875339485741824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463344.005126:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485741824:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788463344.005232:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463344.007235:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463344.007258:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485741952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463344.007325:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463344.007377:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485741952 00000100:00100000:3.0:1788463344.007385:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485741952 00000100:00100000:3.0:1788463344.007442:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788463344.007452:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485741952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463344.007479:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463344.007531:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485741952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463344.007539:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788463344.007566:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788463344.007617:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ca80 x1875339485741952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463344.007739:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485741952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463344.010247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485742208:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010386:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485742720:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010411:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010436:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485743232:0@lo:400:kworker.0 00000100:00100000:1.0:1788463344.010451:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742208 00000100:00100000:2.0:1788463344.010458:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463344.010461:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742208 00000100:00100000:2.0:1788463344.010482:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788463344.010491:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485742336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463344.010507:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742720 00000100:00100000:1.0:1788463344.010512:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742720 00000100:00100000:2.0:1788463344.010534:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463344.010537:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743232 00000100:00100000:1.0:1788463344.010541:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743232 00000100:00100000:2.0:1788463344.010558:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485742848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463344.010565:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788463344.010634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010646:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485743360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.010667:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485742464:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010673:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010700:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742848 00000100:00100000:2.0:1788463344.010704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742848 00000100:00100000:0.0:1788463344.010709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010735:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743360 00000100:00100000:2.0:1788463344.010739:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743360 00000100:00100000:0.0:1788463344.010742:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485742976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010763:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742464 00000100:00100000:2.0:1788463344.010767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742464 00000100:00100000:0.0:1788463344.010772:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463344.010797:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788463344.010808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788463344.010808:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485742080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010820:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485742720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.010840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463344.010879:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485742592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010898:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485742720:12345-0@lo:400:kworker.0 Request processed in 78us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.010906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788463344.010911:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010931:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788463344.010935:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485743104:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.010942:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485743232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.010961:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.010986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485743232:12345-0@lo:400:kworker.0 Request processed in 46us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.010993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788463344.010997:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742976 00000100:00100000:0.0:1788463344.011002:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742976 00000100:00100000:2.0:1788463344.011009:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788463344.011018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485742848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011066:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743104 00000100:00100000:2.0:1788463344.011071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485742848:12345-0@lo:400:kworker.0 Request processed in 53us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.011071:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743104 00000100:00100000:2.0:1788463344.011092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788463344.011101:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463344.011112:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485742976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011115:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788463344.011128:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485743360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011162:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485742976:12345-0@lo:400:kworker.0 Request processed in 51us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.011172:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485743360:12345-0@lo:400:kworker.0 Request processed in 46us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.011173:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463344.011183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788463344.011193:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788463344.011207:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788463344.011207:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485743104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011221:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485742464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011245:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485743104:12345-0@lo:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.011254:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788463344.011265:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485742464:12345-0@lo:400:kworker.0 Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.011274:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788463344.011277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742080 00000100:00100000:0.0:1788463344.011282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742080 00000100:00100000:2.0:1788463344.011313:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742336 00000100:00100000:0.0:1788463344.011318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788463344.011320:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742336 00000100:00100000:0.0:1788463344.011327:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485742080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011351:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485742592 00000100:00100000:2.0:1788463344.011356:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485742592 00000100:00100000:0.0:1788463344.011363:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485742080:12345-0@lo:400:kworker.0 Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.011372:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788463344.011376:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788463344.011385:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485742336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011407:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463344.011418:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485742592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011427:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485742336:12345-0@lo:400:kworker.0 Request processed in 41us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.011435:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463344.011469:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485742592:12345-0@lo:400:kworker.0 Request processed in 53us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463344.011476:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788463344.011495:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485742336:0@lo:400:kworker.0 00010000:00080000:2.0:1788463344.011513:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e00000 x1875339485742848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463344.011525:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485742080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011526:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485742848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011545:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485742592:0@lo:400:kworker.0 00010000:00080000:2.0:1788463344.011549:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec2a00 x1875339485743360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788463344.011561:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec1c00 x1875339485743104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463344.011571:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485743104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463344.011605:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485742464:0@lo:400:kworker.0 00010000:00080000:0.0:1788463344.011615:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e01500 x1875339485742976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463344.011623:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485742976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011887:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485743360:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485742720:0@lo:400:kworker.0 00000100:00100000:2.0:1788463344.011911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485743232:0@lo:400:kworker.0 00000100:00080000:3.0:1788463344.014555:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463344.014566:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463344.014568:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463344.023330:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485742208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463344.023448:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485742208:12345-0@lo:400:kworker.0 Request processed in 12874us (13115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463344.023459:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788463344.023609:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485742208:0@lo:400:kworker.0 00010000:00010000:1.0:1788463344.268975:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463344.524835:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463344.524860:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485743488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463344.524941:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463344.525042:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743488 00000100:00100000:2.0:1788463344.525054:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743488 00000100:00100000:2.0:1788463344.525131:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788463344.525140:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485743488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463344.525179:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463344.525228:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485743488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463344.525234:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788463344.525374:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485743488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463345.028421:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485743616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463345.028500:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.028614:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743616 00000100:00100000:3.0:1788463345.028623:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743616 00000100:00100000:3.0:1788463345.028685:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788463345.028695:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485743616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463345.028728:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463345.029568:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485743616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 870us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.029598:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788463345.029840:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485743616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463345.284869:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463346.020316:0:12613:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463346.020691:0:12613:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788463346.308345:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463346.927989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463346.928202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463346.928234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463346.928376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785792 00000100:00100000:2.0:1788463346.928386:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785792 00000100:00100000:0.0:1788463346.928505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463346.928539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463346.928563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463346.929555:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786048 00000100:00100000:2.0:1788463346.929564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786048 00000100:00100000:2.0:1788463346.929607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785920 00000100:00100000:2.0:1788463346.929610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785920 00000100:00100000:2.0:1788463346.929623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786176 00000100:00100000:2.0:1788463346.929626:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786176 00000100:00100000:2.0:1788463346.929642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 185 00000100:00100000:2.0:1788463346.929652:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466785792:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463346.929734:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466785792:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 83us (1766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.929742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 185 00000100:00100000:2.0:1788463346.930186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:2.0:1788463346.930197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466786048:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463346.930233:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466786048:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 40us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.930240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:2.0:1788463346.930253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:0.0:1788463346.930363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00080000:3.0:1788463346.930709:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463346.930716:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463346.930916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466785920:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463346.930953:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466785920:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.930960:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:2.0:1788463346.930992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:2.0:1788463346.931001:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466786176:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463346.934508:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466786176:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 3497us (5957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.934521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:2.0:1788463346.934570:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786304 00000100:00100000:2.0:1788463346.934589:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786304 00000100:00100000:2.0:1788463346.934646:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786432 00000100:00100000:2.0:1788463346.934650:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786432 00000100:00100000:2.0:1788463346.934668:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463346.934676:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2399:x1875339466786304:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:2.0:1788463346.934702:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39845 00000100:00080000:2.0:1788463346.934711:0:8440:0:(import.c:65:import_set_state_nolock()) ffff961787d20800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463346.934770:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788463346.934913:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+2:2399:x1875339466786304:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 237us (6348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.934920:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463346.934930:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:2.0:1788463346.934936:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2399:x1875339466786432:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:2.0:1788463346.934945:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3984c 00000100:00080000:2.0:1788463346.934950:0:8440:0:(import.c:65:import_set_state_nolock()) ffff961787d23000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463346.934993:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788463346.935068:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+2:2399:x1875339466786432:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 132us (4705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463346.935075:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00010000:00010000:2.0:1788463346.935093:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463346.935098:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463346.935613:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463346.935618:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463346.939532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466785664 00000100:00100000:3.0:1788463346.939549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466785664 00000100:00100000:3.0:1788463346.939632:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 315 00000100:00100000:3.0:1788463346.939643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466785664:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463346.939712:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466785664:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 72us (11477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463346.939720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 315 00010000:00010000:0.0:1788463347.332726:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463347.606899:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485743744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463347.606989:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463347.607063:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743744 00000100:00100000:3.0:1788463347.607071:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743744 00000100:00100000:3.0:1788463347.607121:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788463347.607131:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485743744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463347.607160:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463347.607201:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485743744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463347.607208:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788463347.607226:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463347.607252:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ca80 x1875339485743744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463347.607269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485743744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463348.101551:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463348.101603:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485743872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463348.101683:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463348.101803:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485743872 00000100:00100000:0.0:1788463348.101813:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485743872 00000100:00100000:0.0:1788463348.101883:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788463348.101910:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485743872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463348.101939:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463348.102002:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485743872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463348.102010:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788463348.102059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e00000 x1875339485743872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463348.102080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485743872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463348.102135:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463348.359736:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463348.528100:0:12710:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463348.528389:0:12710:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788463349.124051:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463349.124076:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485744000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463349.124155:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463349.125353:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744000 00000100:00100000:2.0:1788463349.125365:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744000 00000100:00100000:2.0:1788463349.125432:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463349.125446:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485744000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463349.125476:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463349.125540:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485744000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463349.125546:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788463349.126153:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463349.126169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485744128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463349.126206:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.126248:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744128 00000100:00100000:0.0:1788463349.126252:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744128 00000100:00100000:0.0:1788463349.126278:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463349.126286:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485744128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463349.126311:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463349.126344:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485744128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.126351:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788463349.126400:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e00000 x1875339485744128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463349.126419:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485744128:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788463349.127100:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788463349.127133:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787b5ca80 x1875339485744000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463349.127149:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485744000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463349.136277:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485744384:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136358:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136419:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485744896:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136482:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485745408:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136527:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788463349.136532:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485744256:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136599:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136626:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136647:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.136669:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.136701:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744384 00000100:00100000:3.0:1788463349.136708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744384 00000100:00100000:2.0:1788463349.136892:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744896 00000100:00100000:2.0:1788463349.136897:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744896 00000100:00100000:2.0:1788463349.136956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745408 00000100:00100000:2.0:1788463349.136960:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745408 00000100:00100000:2.0:1788463349.136989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788463349.136998:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485744896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.137070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485744896:12345-0@lo:400:kworker.0 Request processed in 74us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463349.137077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788463349.137103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788463349.137109:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485745408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.137135:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485745408:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463349.137141:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788463349.137471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788463349.137480:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485744384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.137514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485744384:12345-0@lo:400:kworker.0 Request processed in 37us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463349.137520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788463349.137544:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744768 00000100:00100000:3.0:1788463349.137548:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744768 00000100:00100000:3.0:1788463349.137572:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788463349.137607:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485744768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.137642:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485744768:12345-0@lo:400:kworker.0 Request processed in 36us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463349.137648:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788463349.137665:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745280 00000100:00100000:0.0:1788463349.137667:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744256 00000100:00100000:3.0:1788463349.137669:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745280 00000100:00100000:0.0:1788463349.137671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744256 00000100:00100000:3.0:1788463349.137701:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463349.137701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788463349.137708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485745280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.137708:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485744256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485744256:12345-0@lo:400:kworker.0 Request processed in 3476us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.141207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788463349.141284:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485744512:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141331:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.141362:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485745024:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141396:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.141418:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485745536:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141439:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.141461:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463349.141467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485744640:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.141503:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485745152:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141523:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463349.141553:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744512 00000100:00100000:0.0:1788463349.141560:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744512 00000100:00100000:0.0:1788463349.141614:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788463349.141622:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485744512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141674:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485744512:12345-0@lo:400:kworker.0 Request processed in 53us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.141680:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788463349.141697:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745024 00000100:00100000:0.0:1788463349.141700:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745024 00000100:00100000:0.0:1788463349.141724:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745536 00000100:00100000:0.0:1788463349.141727:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745536 00000100:00100000:0.0:1788463349.141741:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485744640 00000100:00100000:0.0:1788463349.141753:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485744640 00000100:00100000:0.0:1788463349.141769:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788463349.141775:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485745024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141822:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485745024:12345-0@lo:400:kworker.0 Request processed in 46us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.141829:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788463349.141840:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788463349.141846:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485745536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141871:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485745536:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.141877:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788463349.141887:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788463349.141893:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485744640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.141917:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485744640:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.141922:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788463349.141953:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745152 00000100:00100000:0.0:1788463349.141957:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745152 00000100:00100000:0.0:1788463349.141983:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463349.141989:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485745152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.142020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485745152:12345-0@lo:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463349.142026:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463349.142081:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485744640:0@lo:400:kworker.0 00010000:00080000:0.0:1788463349.142095:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617869d0000 x1875339485745152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463349.142118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485745152:0@lo:400:kworker.0 00000100:00100000:0.0:1788463349.142129:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485744512:0@lo:400:kworker.0 00010000:00080000:0.0:1788463349.142138:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23100 x1875339485745024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463349.142146:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485745024:0@lo:400:kworker.0 00010000:00080000:0.0:1788463349.142155:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617869d0a80 x1875339485745536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463349.142162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485745536:0@lo:400:kworker.0 00000100:00080000:2.0:1788463349.148195:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463349.148209:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463349.148212:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463349.148283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485744256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.148311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485744768:0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.148326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485744384:0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.148339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485744896:0@lo:400:kworker.0 00000100:00100000:2.0:1788463349.148353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485745408:0@lo:400:kworker.0 00010000:00080000:2.0:1788463349.148393:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617869d3800 x1875339485745280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463349.148404:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485745280:0@lo:400:kworker.0 00000100:00100000:3.0:1788463349.148407:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485745280:12345-0@lo:400:kworker.0 Request processed in 10696us (11733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463349.148420:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1788463349.382372:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463349.636796:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485745664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463349.636871:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463349.637133:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745664 00000100:00100000:2.0:1788463349.637143:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745664 00000100:00100000:2.0:1788463349.637199:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788463349.637217:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485745664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463349.637252:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463349.637304:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485745664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463349.637311:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788463349.637369:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485745664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463350.148874:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463350.148902:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485745792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463350.151772:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463350.152014:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745792 00000100:00100000:0.0:1788463350.152023:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745792 00000100:00100000:0.0:1788463350.152079:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788463350.152087:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485745792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463350.152122:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463350.152179:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485745792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463350.152186:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463350.152257:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485745792:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463350.403819:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463351.336807:0:12807:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463351.337150:0:12807:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463351.428417:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463352.055618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463352.055659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463352.055699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463352.055739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463352.055769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463352.055808:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786560 00000100:00100000:0.0:1788463352.055818:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786560 00000100:00100000:0.0:1788463352.055885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 317 00000100:00100000:0.0:1788463352.055896:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466786560:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463352.055969:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466786560:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463352.055977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 317 00000100:00100000:0.0:1788463352.056014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786688 00000100:00100000:0.0:1788463352.056019:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786688 00000100:00100000:0.0:1788463352.056057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786944 00000100:00100000:0.0:1788463352.056061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786944 00000100:00100000:0.0:1788463352.056077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466786816 00000100:00100000:0.0:1788463352.056080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466786816 00000100:00100000:0.0:1788463352.056093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787072 00000100:00100000:0.0:1788463352.056096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787072 00000100:00100000:0.0:1788463352.056113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:0.0:1788463352.056120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466786688:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463352.056154:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466786688:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463352.056298:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:2.0:1788463352.060009:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:2.0:1788463352.060037:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466786944:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463352.060205:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466786944:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 180us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463352.060213:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:2.0:1788463352.060241:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:2.0:1788463352.060251:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466786816:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463352.060282:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466786816:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463352.060288:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:2.0:1788463352.060303:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00100000:2.0:1788463352.060311:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466787072:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463352.060343:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466787072:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 33us (4572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463352.060348:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00080000:1.0:1788463352.060803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463352.060815:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463352.451796:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463352.710291:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463352.710314:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485745920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463352.710393:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463352.710525:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485745920 00000100:00100000:3.0:1788463352.710534:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485745920 00000100:00100000:3.0:1788463352.710625:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788463352.710636:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485745920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463352.710666:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463352.710713:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485745920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463352.710720:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788463352.710756:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf30a80 x1875339485745920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463352.710773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485745920:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463352.711023:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788463352.715302:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000020:00000080:0.0:1788463352.715314:0:8434:0:(genops.c:885:class_export_put()) final put ffff961787d21800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000020:00000080:3.0:1788463352.716490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d21800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d for lustre-OST0000 00000020:00000080:3.0:1788463352.716543:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787d20800 for lustre-OST0000 00000001:00100000:3.0:1788463352.719528:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000020:00000080:3.0:1788463352.719538:0:9518:0:(genops.c:885:class_export_put()) final put ffff961787d25800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000020:00000080:2.0:1788463352.719783:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d25800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d for lustre-OST0001 00000020:00000080:2.0:1788463352.722031:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787d23000 for lustre-OST0001 00000100:00100000:2.0:1788463353.219878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485746048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463353.219968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463353.221501:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746048 00000100:00100000:3.0:1788463353.221672:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746048 00000100:00100000:3.0:1788463353.221748:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463353.221773:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485746048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463353.221799:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463353.221900:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485746048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463353.221907:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788463353.222036:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463353.222355:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787852300 x1875339485746048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463353.222396:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485746048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463353.480400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788463353.910952:0:12905:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463353.913288:0:12905:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788463354.245680:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485746176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463354.245796:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463354.246061:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746176 00000100:00100000:3.0:1788463354.246073:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746176 00000100:00100000:3.0:1788463354.246150:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463354.246164:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485746176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463354.246217:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463354.246285:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485746176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463354.246304:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788463354.246376:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787850e00 x1875339485746176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463354.246399:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485746176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463354.246653:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463354.246667:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463354.246700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247668:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485746560:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247722:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247754:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485747072:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247777:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247803:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485747584:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247841:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247863:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788463354.247870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485746688:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247918:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485747200:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247941:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.247958:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485747712:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.247979:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.248013:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746560 00000100:00100000:1.0:1788463354.248022:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746560 00000100:00100000:1.0:1788463354.248067:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747072 00000100:00100000:1.0:1788463354.248069:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747072 00000100:00100000:1.0:1788463354.248087:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747584 00000100:00100000:1.0:1788463354.248089:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747584 00000100:00100000:1.0:1788463354.248122:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747200 00000100:00100000:1.0:1788463354.248125:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747200 00000100:00100000:1.0:1788463354.248141:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747712 00000100:00100000:1.0:1788463354.248144:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747712 00000100:00100000:1.0:1788463354.248160:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788463354.248168:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485746560:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788463354.248409:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463354.248415:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463354.248418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463354.248435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788463354.248444:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485747072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248486:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485747072:12345-0@lo:400:kworker.0 Request processed in 44us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463354.248494:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788463354.248514:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788463354.248519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485747584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248544:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485747584:12345-0@lo:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463354.248550:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788463354.248560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788463354.248565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485747200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485747200:12345-0@lo:400:kworker.0 Request processed in 50us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463354.248623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788463354.248638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788463354.248644:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248668:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485747712:12345-0@lo:400:kworker.0 Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463354.248673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788463354.248721:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746688 00000100:00100000:0.0:1788463354.248725:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746688 00000100:00100000:0.0:1788463354.248764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788463354.248770:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485746688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248802:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485746688:12345-0@lo:400:kworker.0 Request processed in 33us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463354.248809:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788463354.248876:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485746688:0@lo:400:kworker.0 00010000:00080000:0.0:1788463354.248890:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae1180 x1875339485747200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463354.248901:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485747200:0@lo:400:kworker.0 00010000:00080000:0.0:1788463354.248911:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae2d80 x1875339485747712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463354.248919:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485747712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248930:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485746560:0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248939:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485747072:0@lo:400:kworker.0 00000100:00100000:0.0:1788463354.248948:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485747584:0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.250630:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485746560:12345-0@lo:400:kworker.0 Request processed in 2447us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463354.250649:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788463354.251075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485746432:0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251174:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463354.251245:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485746944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463354.251313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485747456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251340:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463354.251372:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788463354.251379:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485746816:0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463354.251427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485747328:0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463354.251483:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747456 00000100:00100000:2.0:1788463354.251493:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747456 00000100:00100000:2.0:1788463354.251548:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747328 00000100:00100000:2.0:1788463354.251551:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747328 00000100:00100000:2.0:1788463354.251627:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463354.251636:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485747456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251700:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485747456:12345-0@lo:400:kworker.0 Request processed in 65us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463354.251707:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463354.251722:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788463354.251728:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485747328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251755:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485747328:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463354.251782:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788463354.251810:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463354.251823:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746816 00000100:00100000:2.0:1788463354.251839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746816 00000100:00100000:2.0:1788463354.251869:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788463354.251875:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463354.251910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485746816:12345-0@lo:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463354.251917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788463354.251962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485746816:0@lo:400:kworker.0 00010000:00080000:2.0:1788463354.251978:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae0380 x1875339485747328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463354.251988:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485747328:0@lo:400:kworker.0 00010000:00080000:2.0:1788463354.251998:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae2a00 x1875339485747456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463354.252005:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485747456:0@lo:400:kworker.0 00000100:00100000:3.0:1788463354.252273:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746944 00000100:00100000:3.0:1788463354.252280:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746944 00000100:00100000:3.0:1788463354.252334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788463354.252343:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485746944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463354.252395:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485746944:12345-0@lo:400:kworker.0 Request processed in 54us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463354.252401:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788463354.252432:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746304 00000100:00100000:3.0:1788463354.252445:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746304 00000100:00100000:3.0:1788463354.252484:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463354.252490:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485746304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463354.252511:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463354.252548:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485746304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463354.252554:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788463354.252601:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463354.252630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485746944:0@lo:400:kworker.0 00010000:00080000:3.0:1788463354.252646:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ec2d80 x1875339485746304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463354.252663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463354.252977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485746432 00000100:00100000:1.0:1788463354.252983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485746432 00000100:00100000:1.0:1788463354.253027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788463354.253035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485746432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463354.253090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485746432:12345-0@lo:400:kworker.0 Request processed in 55us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463354.253097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788463354.253232:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485746432:0@lo:400:kworker.0 00010000:00010000:2.0:1788463354.500037:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463354.760563:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463354.760619:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485747840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463354.760721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463354.760851:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747840 00000100:00100000:1.0:1788463354.760861:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747840 00000100:00100000:1.0:1788463354.760921:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788463354.760931:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485747840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463354.760978:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463354.761039:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485747840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463354.761047:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788463354.761117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485747840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463355.268515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463355.268631:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485747968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463355.268735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463355.268854:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485747968 00000100:00100000:3.0:1788463355.268866:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485747968 00000100:00100000:3.0:1788463355.269061:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788463355.269074:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485747968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463355.269128:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463355.269437:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485747968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 364us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463355.269445:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788463355.269553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485747968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463355.532297:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463356.547905:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463357.164937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463357.164989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463357.165021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463357.165040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463357.165073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463357.165121:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787456 00000100:00100000:3.0:1788463357.165130:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787456 00000100:00100000:3.0:1788463357.165183:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787712 00000100:00100000:3.0:1788463357.165198:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787712 00000100:00100000:3.0:1788463357.165213:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787328 00000100:00100000:3.0:1788463357.165216:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787328 00000100:00100000:3.0:1788463357.165227:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787584 00000100:00100000:3.0:1788463357.165230:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787584 00000100:00100000:3.0:1788463357.165255:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 205 00000100:00100000:3.0:1788463357.165265:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466787456:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463357.165340:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466787456:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463357.165347:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 205 00000100:00100000:3.0:1788463357.165364:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 206 00000100:00100000:3.0:1788463357.165369:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466787712:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463357.165391:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466787712:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463357.165397:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 206 00000100:00100000:3.0:1788463357.165406:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 207 00000100:00100000:3.0:1788463357.165411:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466787328:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463357.165433:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466787328:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463357.165439:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 207 00000100:00100000:3.0:1788463357.165448:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 208 00000100:00100000:3.0:1788463357.165454:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466787584:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463357.165473:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466787584:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463357.165484:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 208 00000100:00080000:3.0:1788463357.165501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463357.165504:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463357.165989:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787200 00000100:00100000:1.0:1788463357.165996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787200 00000100:00100000:1.0:1788463357.166039:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 319 00000100:00100000:1.0:1788463357.166047:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466787200:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463357.166087:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466787200:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463357.166095:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 319 00010000:00010000:2.0:1788463357.572039:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463357.831174:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485748096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463357.831272:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463357.831566:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748096 00000100:00100000:3.0:1788463357.831599:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748096 00000100:00100000:3.0:1788463357.831660:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788463357.831671:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485748096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463357.831702:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463357.831754:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485748096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463357.831772:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788463357.831818:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617869d2680 x1875339485748096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463357.831838:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485748096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788463357.831990:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463358.339699:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485748224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463358.339775:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463358.339857:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748224 00000100:00100000:2.0:1788463358.339870:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748224 00000100:00100000:2.0:1788463358.339929:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788463358.339942:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485748224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463358.339978:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463358.340024:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485748224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463358.340032:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788463358.340053:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463358.340084:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617869d1f80 x1875339485748224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463358.340102:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485748224:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788463358.475944:0:13049:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788463358.599377:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463359.367439:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485748352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463359.367514:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463359.367744:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463359.367754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485748480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463359.367785:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463359.367817:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748352 00000100:00100000:1.0:1788463359.367825:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748352 00000100:00100000:1.0:1788463359.367867:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748480 00000100:00100000:1.0:1788463359.367871:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748480 00000100:00100000:1.0:1788463359.367889:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463359.367898:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485748352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463359.367928:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463359.367982:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485748352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463359.367990:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463359.368024:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463359.368030:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485748480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463359.368040:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463359.368065:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485748480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463359.368071:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788463359.368089:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463359.368116:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae0e00 x1875339485748480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463359.368134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485748480:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788463359.368146:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787853800 x1875339485748352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463359.368155:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787853800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485748352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463359.368332:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485748864:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368360:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463359.368376:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485749376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463359.368416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485749888:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368435:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463359.368451:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463359.368456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485748992:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463359.368503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485749504:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463359.368547:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749376 00000100:00100000:3.0:1788463359.368551:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749376 00000100:00100000:3.0:1788463359.368602:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749888 00000100:00100000:3.0:1788463359.368605:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749888 00000100:00100000:3.0:1788463359.368624:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748992 00000100:00100000:3.0:1788463359.368627:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748992 00000100:00100000:3.0:1788463359.368640:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788463359.368646:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368681:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485749376:12345-0@lo:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463359.368687:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788463359.368699:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788463359.368704:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368741:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485749888:12345-0@lo:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463359.368747:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788463359.368758:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788463359.368764:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485748992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.368788:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485748992:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463359.368793:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788463359.368817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485748992:0@lo:400:kworker.0 00010000:00080000:3.0:1788463359.368826:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843e4000 x1875339485749376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463359.368841:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485749376:0@lo:400:kworker.0 00010000:00080000:3.0:1788463359.368851:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843e5180 x1875339485749888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463359.368859:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485749888:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369100:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369131:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369159:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369211:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485749760:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369232:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369244:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788463359.369250:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369313:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369335:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369352:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485749632:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369373:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463359.369399:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748736 00000100:00100000:2.0:1788463359.369410:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748736 00000100:00100000:2.0:1788463359.369435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749248 00000100:00100000:2.0:1788463359.369437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749248 00000100:00100000:2.0:1788463359.369451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749760 00000100:00100000:2.0:1788463359.369453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749760 00000100:00100000:2.0:1788463359.369468:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788463359.369474:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369510:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485748736:12345-0@lo:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369517:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788463359.369529:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788463359.369536:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485749248:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369567:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788463359.369612:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788463359.369620:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485749760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369646:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485749760:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369652:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788463359.369677:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749504 00000100:00100000:2.0:1788463359.369680:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749504 00000100:00100000:2.0:1788463359.369702:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749632 00000100:00100000:2.0:1788463359.369705:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749632 00000100:00100000:2.0:1788463359.369721:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463359.369742:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485749504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369773:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485749504:12345-0@lo:400:kworker.0 Request processed in 47us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369789:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463359.369801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463359.369807:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485749632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485749632:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369839:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463359.369861:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748608 00000100:00100000:2.0:1788463359.369864:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748608 00000100:00100000:2.0:1788463359.369888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788463359.369895:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485748608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.369925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485748608:12345-0@lo:400:kworker.0 Request processed in 31us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.369931:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788463359.369958:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485748864 00000100:00100000:2.0:1788463359.369962:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485748864 00000100:00100000:2.0:1788463359.369982:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485749120 00000100:00100000:2.0:1788463359.369985:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485749120 00000100:00100000:2.0:1788463359.369998:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788463359.370003:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370035:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485748864:12345-0@lo:400:kworker.0 Request processed in 32us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.370040:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788463359.370050:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788463359.370056:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370081:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485749120:12345-0@lo:400:kworker.0 Request processed in 25us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463359.370096:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788463359.370130:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370142:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485749120:0@lo:400:kworker.0 00010000:00080000:2.0:1788463359.370153:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843e7b80 x1875339485749632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463359.370162:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485749632:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370172:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370181:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463359.370191:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485749760:0@lo:400:kworker.0 00000100:00080000:1.0:1788463359.370435:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463359.370440:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463359.370443:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788463359.370533:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843e7800 x1875339485749504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463359.370543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485749504:0@lo:400:kworker.0 00000100:00100000:3.0:1788463359.370555:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485748864:0@lo:400:kworker.0 00010000:00010000:3.0:1788463359.619850:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463359.879834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485750016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463359.879921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463359.880049:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750016 00000100:00100000:1.0:1788463359.880059:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750016 00000100:00100000:1.0:1788463359.880127:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788463359.880137:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485750016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463359.880172:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463359.880232:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485750016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463359.880239:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788463359.880547:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485750016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463360.389287:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463360.389315:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485750144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463360.389417:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463360.389509:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750144 00000100:00100000:2.0:1788463360.389520:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750144 00000100:00100000:2.0:1788463360.389719:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788463360.389732:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485750144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463360.389795:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463360.389871:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485750144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463360.389878:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788463360.389965:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485750144:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463360.643745:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463361.667809:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463362.291403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463362.291477:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463362.293115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787968 00000100:00100000:2.0:1788463362.293138:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787968 00000100:00100000:2.0:1788463362.293227:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 215 00000100:00100000:2.0:1788463362.293243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466787968:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463362.293364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466787968:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 126us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463362.293372:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 215 00000100:00080000:1.0:1788463362.293786:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463362.294567:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466787840 00000100:00100000:0.0:1788463362.294626:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466787840 00000100:00100000:0.0:1788463362.294698:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 321 00000100:00100000:0.0:1788463362.294710:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466787840:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463362.294811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466787840:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 102us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463362.294819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 321 00000100:00100000:1.0:1788463362.296942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463362.296999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463362.297175:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788096 00000100:00100000:0.0:1788463362.297188:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788096 00000100:00100000:0.0:1788463362.297273:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788224 00000100:00100000:0.0:1788463362.297277:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788224 00000100:00100000:0.0:1788463362.297526:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 216 00000100:00100000:0.0:1788463362.297539:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466788096:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463362.297685:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466788096:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 148us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463362.297693:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 216 00000100:00100000:0.0:1788463362.297713:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 217 00000100:00100000:0.0:1788463362.297720:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466788224:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:1.0:1788463362.297791:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463362.297796:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463362.300609:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466788224:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 2869us (3590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463362.300629:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 217 00000100:00100000:0.0:1788463362.300775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463362.300937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788352 00000100:00100000:0.0:1788463362.300950:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788352 00000100:00080000:1.0:1788463362.300995:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463362.301041:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 218 00000100:00100000:0.0:1788463362.301051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466788352:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463362.301144:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466788352:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 94us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463362.301151:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 218 00000020:00000080:0.0:1788463362.558209:0:13197:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde66ba2e0 20000000:00000080:0.0:1788463362.558234:0:13197:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961787fbf000 uarg=0000000000000000 20000000:01000000:0.0:1788463362.558296:0:13197:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463362.558304:0:13197:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463362.558317:0:13197:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788463362.559486:0:13198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788463362.560007:0:13197:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788463362.570170:0:13197:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463362.570335:0:13197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570362:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570372:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397ea expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570379:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570386:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39806 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570393:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39814 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570401:0:13197:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570429:0:13197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570481:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.570498:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.570516:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750272:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463362.571600:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.571616:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 23 pid: 6516 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.571630:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750400:0@lo:104: 00000100:00100000:2.0:1788463362.571720:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463362.571788:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.571797:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 23 pid: 6517 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.571805:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750528:0@lo:104: 00000100:00100000:2.0:1788463362.572038:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463362.572066:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.572087:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 23 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.572097:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750656:0@lo:104: 00000100:00100000:2.0:1788463362.572124:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463362.572226:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.572234:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 23 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.572243:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750784:0@lo:104: 00000100:00100000:2.0:1788463362.572267:0:13197:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463362.572287:0:13197:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.572296:0:13197:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.572306:0:13197:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750912:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463362.572338:0:13197:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463362.572442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750400 00000100:00100000:3.0:1788463362.572453:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750400 00000100:00100000:3.0:1788463362.572509:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750528 00000100:00100000:3.0:1788463362.572512:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750528 00000100:00100000:3.0:1788463362.572522:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750656 00000100:00100000:3.0:1788463362.572524:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750656 00000100:00100000:3.0:1788463362.572533:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485750784 00000100:00100000:3.0:1788463362.572535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485750784 00000100:00100000:3.0:1788463362.572550:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463362.572560:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:13197:x1875339485750400:12345-0@lo:104: 00010000:00010000:3.0:1788463362.572619:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.572707:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463362.572714:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:13197:x1875339485750400:12345-0@lo:104: Request processed in 156us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.572733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463362.572769:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463362.572775:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:13197:x1875339485750528:12345-0@lo:104: 00010000:00010000:3.0:1788463362.572783:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.572821:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463362.572827:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:13197:x1875339485750528:12345-0@lo:104: Request processed in 53us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.572833:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463362.572856:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463362.572861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:13197:x1875339485750656:12345-0@lo:104: 00010000:00010000:3.0:1788463362.572869:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.572905:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788463362.572910:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:13197:x1875339485750656:12345-0@lo:104: Request processed in 49us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.572915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463362.572926:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463362.572932:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:13197:x1875339485750784:12345-0@lo:104: 00010000:00010000:3.0:1788463362.572940:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.572979:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788463362.572984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:13197:x1875339485750784:12345-0@lo:104: Request processed in 53us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.572997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788463362.573020:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788463362.573027:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573035:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463362.573040:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573050:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463362.573059:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463362.573066:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463362.573108:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573115:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463362.573149:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573157:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21c00/0x841acb7f42a39814 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3981b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573175:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463362.573179:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573196:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463362.573200:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573206:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463362.573211:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463362.573216:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463362.573231:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573237:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463362.573258:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573264:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e20600/0x841acb7f42a39806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3980d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573273:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463362.573275:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573280:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463362.573282:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573298:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463362.573303:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463362.573308:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463362.573321:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573327:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463362.573332:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573339:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a397f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397ff expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573348:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463362.573351:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573357:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463362.573359:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573366:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463362.573373:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463362.573385:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463362.573398:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573404:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463362.573410:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573417:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e20000/0x841acb7f42a397ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a397f1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573431:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463362.573433:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463362.573434:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463362.573443:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463362.573450:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463362.573473:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485751040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.573517:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463362.573557:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463362.573563:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485751424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.573620:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463362.573656:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485751296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.573692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463362.573713:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463362.573719:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485751168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.573738:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463362.573767:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751040 00000100:00100000:3.0:1788463362.573780:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751040 00010000:00010000:3.0:1788463362.573806:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 24 pid: 6516 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.573832:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751424 00000100:00100000:3.0:1788463362.573835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751424 00010000:00010000:3.0:1788463362.573846:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 25 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.573856:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751296 00000100:00100000:3.0:1788463362.573859:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751296 00010000:00010000:3.0:1788463362.573870:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 26 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.573880:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751168 00000100:00100000:3.0:1788463362.573882:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751168 00010000:00010000:3.0:1788463362.573893:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 27 pid: 6517 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.573912:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463362.573919:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3651:x1875339485751040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.573934:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.573940:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 27 pid: 6516 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573951:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 27 pid: 6516 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.573971:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.574002:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3651:x1875339485751040:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.574010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463362.574035:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463362.574041:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+26:3651:x1875339485751424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.574049:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.574053:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 26 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574061:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 26 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574071:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.574092:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+26:3651:x1875339485751424:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.574098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463362.574108:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463362.574114:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+25:3649:x1875339485751296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.574122:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.574125:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 25 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574133:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 25 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574142:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.574165:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+25:3649:x1875339485751296:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.574170:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463362.574185:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463362.574191:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485751168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.574209:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.574213:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 24 pid: 6517 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574222:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 24 pid: 6517 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.574231:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.574251:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485751168:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.574256:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463362.574300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485751168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.574308:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485751296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.574333:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485751424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463362.574338:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485751040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463362.574679:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21a00/0x841acb7f42a3981b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39814 expref: 23 pid: 6516 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.574692:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750400:0@lo:104: 00010000:00010000:2.0:1788463362.574705:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20400/0x841acb7f42a3980d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39806 expref: 22 pid: 6517 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.574727:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750528:0@lo:104: 00010000:00010000:2.0:1788463362.574743:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030e00/0x841acb7f42a397ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a397f8 expref: 21 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.574751:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750656:0@lo:104: 00010000:00010000:2.0:1788463362.574759:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880030c00/0x841acb7f42a397f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a397ea expref: 20 pid: 6518 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463362.574766:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750784:0@lo:104: 00000100:00100000:2.0:1788463362.587377:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750272:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463362.587396:0:13197:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13197:1875339485750912:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463362.587450:0:13197:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463362.593192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463362.593334:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788480 00000100:00100000:3.0:1788463362.593348:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788480 00010000:00010000:3.0:1788463362.593403:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 13 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.593624:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463362.593637:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466788480:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.593658:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.593677:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 13 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.593710:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 13 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.593735:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5800/0x841acb7f42a397e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765fc expref: 13 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.593758:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.593829:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:2402:x1875339466788480:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 194us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.593837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463362.595791:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463362.595877:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788608 00000100:00100000:3.0:1788463362.595890:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788608 00010000:00010000:3.0:1788463362.595937:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463362.596084:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:3.0:1788463362.596097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:2400:x1875339466788608:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463362.596114:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463362.596121:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596135:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596156:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0cc00/0x841acb7f42a39830 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47663b expref: 12 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596173:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596225:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596233:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596240:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596248:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596254:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463362.596259:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596268:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596290:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.596303:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463362.596372:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:2400:x1875339466788608:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 277us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463362.596380:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00010000:00010000:2.0:1788463362.596501:0:13197:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.596512:0:13197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463362.596518:0:13197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21200/0x841acb7f42a39853 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.692065:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463362.950430:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463362.950470:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485751552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463362.950610:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463362.950884:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751552 00000100:00100000:1.0:1788463362.950898:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751552 00000100:00100000:1.0:1788463362.950996:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463362.951008:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485751552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463362.951048:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463362.951107:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485751552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463362.951116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788463362.951325:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463362.951413:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2fb80 x1875339485751552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463362.951451:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485751552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463363.460235:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485751680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463363.460341:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.460549:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751680 00000100:00100000:1.0:1788463363.460560:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751680 00000100:00100000:1.0:1788463363.460691:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463363.460703:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485751680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463363.460746:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788463363.461086:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463363.461239:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485751680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 537us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463363.461248:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788463363.461329:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2c000 x1875339485751680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463363.461353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485751680:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463363.717977:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463363.908126:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463363.908138:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f993000 from 7 10000000:01000000:3.0:1788463363.908145:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463363.908220:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.908236:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.908251:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463363.908299:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485751808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.908402:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463363.908497:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463363.909451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751808 00000100:00100000:1.0:1788463363.909484:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751808 00000100:00100000:1.0:1788463363.909564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788463363.909604:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485751808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463363.909625:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463363.909661:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3985a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.909699:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3985a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.909713:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3985a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.909723:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:1.0:1788463363.909817:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485751808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463363.909825:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788463363.911530:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485751808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463363.911570:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.911630:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463363.911765:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485751936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.911848:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463363.911996:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.912983:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485751936 00000100:00100000:2.0:1788463363.912996:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485751936 00000100:00100000:2.0:1788463363.913078:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788463363.913091:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485751936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.913335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485751936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.913344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788463363.914119:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485751936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.914200:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.914281:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463363.914329:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.915190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752064 00000100:00100000:2.0:1788463363.915200:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752064 00000100:00100000:2.0:1788463363.915274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788463363.915286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485752064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.915457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485752064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.915465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788463363.916024:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788463363.919726:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788463363.926374:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788463363.926441:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463363.926458:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.926474:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463363.926487:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463363.926491:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f7d1000 from 7 10000000:01000000:1.0:1788463363.926494:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463363.926546:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.926572:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.926617:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463363.926661:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.926755:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.926801:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.927453:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752192 00000100:00100000:2.0:1788463363.927465:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752192 00000100:00100000:2.0:1788463363.927545:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788463363.927556:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485752192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463363.927603:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463363.927625:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39868 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.927672:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39868 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.927686:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39868 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.927695:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21200, rc 0) 00000100:00100000:2.0:1788463363.927763:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.927779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788463363.929164:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463363.929202:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.929219:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463363.929329:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.929395:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.929453:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.929649:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752320 00000100:00100000:2.0:1788463363.929658:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752320 00000100:00100000:2.0:1788463363.929725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788463363.929736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.929904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.929914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788463363.930179:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.930227:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.930273:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.930305:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.930472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752448 00000100:00100000:2.0:1788463363.930477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752448 00000100:00100000:2.0:1788463363.930519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788463363.930529:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.930665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.930672:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788463363.931298:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463363.932545:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788463363.936740:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788463363.936822:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463363.936839:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.936856:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463363.936872:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463363.936876:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188d0ea000 from 7 10000000:01000000:1.0:1788463363.936879:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463363.936947:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.936957:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.936971:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463363.937007:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.937117:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.937414:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463363.938286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752576 00000100:00100000:2.0:1788463363.938303:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752576 00000100:00100000:2.0:1788463363.938389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788463363.938400:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485752576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463363.938420:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463363.938440:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39876 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.938475:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39876 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.938510:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39876 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.938520:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:2.0:1788463363.938612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.938620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788463363.940440:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463363.940480:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.940495:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463363.940648:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.940728:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.940773:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463363.940839:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752704 00000100:00100000:3.0:1788463363.940848:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752704 00000100:00100000:3.0:1788463363.940910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788463363.940921:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.941087:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463363.941109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788463363.941430:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.941472:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.941516:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463363.941534:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463363.941608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752832 00000100:00100000:3.0:1788463363.941613:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752832 00000100:00100000:3.0:1788463363.941651:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788463363.941659:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.941751:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463363.941757:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788463363.942060:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463363.946690:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788463363.953354:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788463363.953426:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463363.953443:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.953458:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463363.953470:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463363.953473:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618850d0800 from 7 10000000:01000000:3.0:1788463363.953490:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463363.953543:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.953552:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463363.953565:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463363.955711:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.955810:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463363.955859:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463363.956053:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485752960 00000100:00100000:1.0:1788463363.956063:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485752960 00000100:00100000:1.0:1788463363.956140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788463363.956152:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485752960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463363.956175:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463363.956209:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39884 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.956246:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39884 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.956260:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39884 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463363.956270:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c800, rc 0) 00000100:00100000:1.0:1788463363.956333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485752960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463363.956341:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788463363.956674:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485752960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463363.956698:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463363.956709:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463363.956804:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485753088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.956842:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463363.956874:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463363.958495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753088 00000100:00100000:1.0:1788463363.958515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753088 00000100:00100000:1.0:1788463363.958648:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788463363.958660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485753088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463363.958901:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485753088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463363.958979:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485753088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.959042:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485753216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463363.959099:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463363.959129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753216 00000100:00100000:2.0:1788463363.959134:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753216 00000100:00100000:3.0:1788463363.967416:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463363.968212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788463363.973179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788463363.973206:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485753216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463363.973460:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485753216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (14360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463363.973469:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788463363.973975:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485753216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463363.996880:0:13220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788463364.000523:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788463364.000628:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463364.000656:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463364.000673:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463364.079043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463364.079107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788736 00000100:00100000:3.0:1788463364.079120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788736 00000100:00100000:3.0:1788463364.079205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 334 00000100:00100000:3.0:1788463364.079219:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:6174:x1875339466788736:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463364.079243:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463364.079268:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47666c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463364.079307:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463364.079367:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463364.079380:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961880031400, rc 0) 00000100:00100000:3.0:1788463364.079452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466788736:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 237us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.079459:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 334 00000100:00100000:1.0:1788463364.088071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463364.088211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788864 00000100:00100000:2.0:1788463364.088233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788864 00000100:00100000:2.0:1788463364.088312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 335 00000100:00100000:2.0:1788463364.088326:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466788864:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463364.088522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466788864:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 199us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.088530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 335 00000100:00100000:3.0:1788463364.097405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463364.098069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466788992 00000100:00100000:2.0:1788463364.098083:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466788992 00000100:00100000:2.0:1788463364.098173:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 336 00000100:00100000:2.0:1788463364.098185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466788992:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463364.098384:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466788992:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 201us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.098393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 336 00000100:00100000:2.0:1788463364.110127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463364.113122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789120 00000100:00100000:1.0:1788463364.113144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789120 00000100:00100000:1.0:1788463364.113221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 337 00000100:00100000:1.0:1788463364.113235:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466789120:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463364.113257:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463364.113281:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476673 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463364.113319:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463364.113333:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463364.113345:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463364.113432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466789120:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 199us (3333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463364.113439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 337 00000100:00100000:0.0:1788463364.120376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463364.121274:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789248 00000100:00100000:3.0:1788463364.121289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789248 00000100:00100000:3.0:1788463364.121364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 338 00000100:00100000:3.0:1788463364.121379:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466789248:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463364.121608:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466789248:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 232us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.121616:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 338 00000100:00100000:0.0:1788463364.130853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463364.131435:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789376 00000100:00100000:3.0:1788463364.131450:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789376 00000100:00100000:3.0:1788463364.131522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 339 00000100:00100000:3.0:1788463364.131534:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466789376:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463364.131748:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466789376:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 215us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.131758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 339 00000100:00100000:2.0:1788463364.485133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485753728:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463364.485531:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485753344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485695:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485754240:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485726:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.485750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485754752:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485773:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.485830:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485753472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.485878:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485753984:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.485908:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485753600:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.486075:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753728 00000100:00100000:2.0:1788463364.486085:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753728 00000100:00100000:2.0:1788463364.486141:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753472 00000100:00100000:2.0:1788463364.486144:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753472 00000100:00100000:2.0:1788463364.486162:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788463364.486172:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485753728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.486239:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485753728:12345-0@lo:400:kworker.0 Request processed in 68us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.486247:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788463364.486266:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463364.486272:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485753472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.486299:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485753472:12345-0@lo:400:kworker.0 Request processed in 28us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.486304:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463364.486323:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754240 00000100:00100000:2.0:1788463364.486326:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754240 00000100:00100000:2.0:1788463364.486350:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754752 00000100:00100000:2.0:1788463364.486352:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754752 00000100:00100000:2.0:1788463364.486376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463364.486382:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485754240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.486410:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485754240:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.486416:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463364.486425:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788463364.486430:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485754752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.486451:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485754752:12345-0@lo:400:kworker.0 Request processed in 21us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.486466:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788463364.486496:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463364.486536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485753728:0@lo:400:kworker.0 00010000:00080000:2.0:1788463364.486552:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2df80 x1875339485754240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.486562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485754240:0@lo:400:kworker.0 00010000:00080000:2.0:1788463364.486571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2f480 x1875339485754752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.486598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485754752:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.486913:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463364.486980:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485753856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463364.487037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485754368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487059:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463364.487107:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753344 00000100:00100000:3.0:1788463364.487112:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753344 00000100:00100000:3.0:1788463364.487146:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753856 00000100:00100000:3.0:1788463364.487149:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753856 00000100:00100000:3.0:1788463364.487170:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754368 00000100:00100000:3.0:1788463364.487173:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754368 00000100:00100000:3.0:1788463364.487191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788463364.487197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485753344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487238:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485753344:12345-0@lo:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.487244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788463364.487257:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788463364.487262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485753856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485753856:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.487291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788463364.487300:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788463364.487306:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485754368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487326:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485754368:12345-0@lo:400:kworker.0 Request processed in 21us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463364.487331:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788463364.487358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485753344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487376:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485753856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.487384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485754368:0@lo:400:kworker.0 00000100:00080000:2.0:1788463364.488464:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463364.488491:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.488550:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485754112:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.488615:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.488653:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485754624:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.488678:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.488716:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754112 00000100:00100000:2.0:1788463364.488724:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754112 00000100:00100000:2.0:1788463364.488772:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754624 00000100:00100000:2.0:1788463364.488775:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754624 00000100:00100000:2.0:1788463364.488813:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788463364.488824:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485754112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.488874:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485754112:12345-0@lo:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.488882:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788463364.488898:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788463364.489040:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485754624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489072:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485754624:12345-0@lo:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.489079:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788463364.489103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463364.489106:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463364.489119:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.489146:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485754496:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489172:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.489213:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485753472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753600 00000100:00100000:2.0:1788463364.489246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753600 00000100:00100000:2.0:1788463364.489266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485753984 00000100:00100000:2.0:1788463364.489269:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485753984 00000100:00100000:2.0:1788463364.489287:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754496 00000100:00100000:2.0:1788463364.489290:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754496 00000100:00100000:2.0:1788463364.489306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788463364.489312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485753600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489345:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485753600:12345-0@lo:400:kworker.0 Request processed in 33us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.489351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788463364.489362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788463364.489368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489398:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485753984:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.489403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788463364.489414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788463364.489427:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485754496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489456:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485754496:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.489462:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1788463364.489480:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788463364.489504:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2e680 x1875339485753984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.489515:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485753984:0@lo:400:kworker.0 00010000:00080000:2.0:1788463364.489524:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2c380 x1875339485754496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.489531:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485754496:0@lo:400:kworker.0 00000100:00100000:2.0:1788463364.489558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485753600:0@lo:400:kworker.0 00010000:00080000:2.0:1788463364.489569:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2e300 x1875339485754112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.489599:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485754112:0@lo:400:kworker.0 00010000:00080000:2.0:1788463364.489609:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2ea00 x1875339485754624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463364.489616:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485754624:0@lo:400:kworker.0 00000100:00100000:3.0:1788463364.490942:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485754880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463364.491016:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.491615:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485754880 00000100:00100000:2.0:1788463364.491636:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485754880 00000100:00100000:2.0:1788463364.491702:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788463364.491713:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485754880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463364.491753:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463364.491947:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485755008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463364.492411:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463364.495334:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485754880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3607us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.495353:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788463364.495401:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755008 00000100:00100000:2.0:1788463364.495412:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755008 00000100:00100000:2.0:1788463364.495464:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463364.495473:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485755008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463364.495507:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463364.495593:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485755008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463364.495599:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788463364.495725:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2ea00 x1875339485755008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463364.495776:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485755008:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788463364.496266:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae1f80 x1875339485754880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463364.496285:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485754880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788463364.743015:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463365.003371:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463365.003396:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485755136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463365.003475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463365.003614:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755136 00000100:00100000:0.0:1788463365.003636:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755136 00000100:00100000:0.0:1788463365.003694:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788463365.003706:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485755136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463365.003744:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463365.003797:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485755136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463365.003804:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788463365.004197:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485755136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463365.511826:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463365.511849:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485755264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463365.511921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463365.511989:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755264 00000100:00100000:3.0:1788463365.511997:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755264 00000100:00100000:3.0:1788463365.512739:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788463365.512748:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485755264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463365.512783:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463365.512852:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485755264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463365.512859:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788463365.513857:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485755264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463365.771396:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463366.799185:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463367.247119:0:13396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788463367.406749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463367.406809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463367.406835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463367.406855:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463367.406886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463367.406927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789760 00000100:00100000:3.0:1788463367.406938:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789760 00000100:00100000:3.0:1788463367.406995:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790016 00000100:00100000:3.0:1788463367.407001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790016 00000100:00100000:3.0:1788463367.407017:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789632 00000100:00100000:3.0:1788463367.407020:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789632 00000100:00100000:3.0:1788463367.407478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789888 00000100:00100000:3.0:1788463367.407483:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789888 00000100:00100000:3.0:1788463367.407507:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 225 00000100:00100000:3.0:1788463367.407517:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466789760:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463367.410306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466789760:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 2779us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463367.410322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 225 00000100:00100000:3.0:1788463367.410361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 226 00000100:00100000:3.0:1788463367.410391:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466790016:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463367.410452:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466790016:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 66us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463367.410460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 226 00000100:00100000:3.0:1788463367.410475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 227 00000100:00100000:3.0:1788463367.410482:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466789632:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463367.410510:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466789632:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463367.410535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 227 00000100:00100000:3.0:1788463367.410548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 228 00000100:00100000:3.0:1788463367.410556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466789888:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463367.410637:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466789888:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 82us (3750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463367.410643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 228 00000100:00080000:3.0:1788463367.410675:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463367.410680:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463367.411226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466789504 00000100:00100000:1.0:1788463367.411236:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466789504 00000100:00100000:1.0:1788463367.411280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 340 00000100:00100000:1.0:1788463367.411288:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466789504:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463367.411322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466789504:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 35us (4582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463367.411328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 340 00010000:00010000:3.0:1788463367.813385:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463368.068063:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485755392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463368.068147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463368.068476:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755392 00000100:00100000:2.0:1788463368.068486:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755392 00000100:00100000:2.0:1788463368.068568:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788463368.068608:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485755392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463368.068639:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463368.068698:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485755392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463368.068706:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1788463368.068803:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2ce00 x1875339485755392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463368.068821:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485755392:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788463368.068886:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463368.580945:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485755520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463368.581024:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463368.581332:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755520 00000100:00100000:2.0:1788463368.581341:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755520 00000100:00100000:2.0:1788463368.581423:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463368.581449:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485755520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463368.581472:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463368.581516:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485755520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463368.581523:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788463368.582385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463368.582425:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2c380 x1875339485755520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463368.582449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485755520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463368.835895:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463369.603899:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485755648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463369.603976:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463369.604684:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485756160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463369.604722:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463369.604758:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463369.604764:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485756032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.604793:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.605042:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755648 00000100:00100000:2.0:1788463369.605051:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755648 00000100:00100000:2.0:1788463369.605096:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756160 00000100:00100000:2.0:1788463369.605100:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756160 00000100:00100000:2.0:1788463369.605120:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463369.605129:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485755648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463369.605159:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463369.605202:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485755648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463369.605209:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463369.605231:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788463369.605238:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485756160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463369.605248:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463369.605272:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485756160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463369.605278:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788463369.607720:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae2d80 x1875339485756160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463369.607748:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485756160:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788463369.607764:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2e680 x1875339485755648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463369.607776:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485755648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463369.608438:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756032 00000100:00100000:3.0:1788463369.608447:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756032 00000100:00100000:3.0:1788463369.608505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788463369.608514:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485756032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.608630:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485756032:12345-0@lo:400:kworker.0 Request processed in 116us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.608637:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788463369.608670:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485756032:0@lo:400:kworker.0 00000100:00080000:2.0:1788463369.610645:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463369.610665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485756544:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.610732:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.610774:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485757056:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.610797:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.610843:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463369.610858:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485756672:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.610881:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.610896:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485757184:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.610915:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.610955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485755904:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.610980:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611018:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611063:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611084:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611104:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788463369.611111:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485755776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611159:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611175:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611211:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463369.611245:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756928 00000100:00100000:2.0:1788463369.611252:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756928 00000100:00100000:2.0:1788463369.611294:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756800 00000100:00100000:2.0:1788463369.611297:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756800 00000100:00100000:2.0:1788463369.611316:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463369.611324:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611385:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485756928:12345-0@lo:400:kworker.0 Request processed in 61us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463369.611402:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463369.611420:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463369.611427:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485756800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.611455:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485756800:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463369.611462:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788463369.611502:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f22a00 x1875339485756800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463369.611515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485756800:0@lo:400:kworker.0 00010000:00080000:2.0:1788463369.611524:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788441500 x1875339485756928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463369.611545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485756928:0@lo:400:kworker.0 00000100:00100000:0.0:1788463369.612448:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756416 00000100:00100000:0.0:1788463369.612457:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756416 00000100:00100000:0.0:1788463369.612507:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788463369.612515:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485756416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463369.612605:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485756416:12345-0@lo:400:kworker.0 Request processed in 91us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463369.612621:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788463369.612657:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485756416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.613178:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756544 00000100:00100000:3.0:1788463369.613185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756544 00000100:00100000:3.0:1788463369.613224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757056 00000100:00100000:3.0:1788463369.613227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757056 00000100:00100000:3.0:1788463369.613239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756672 00000100:00100000:3.0:1788463369.613241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756672 00000100:00100000:3.0:1788463369.613251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757184 00000100:00100000:3.0:1788463369.613253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757184 00000100:00100000:3.0:1788463369.613264:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755904 00000100:00100000:3.0:1788463369.613266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755904 00000100:00100000:3.0:1788463369.613275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485756288 00000100:00100000:3.0:1788463369.613278:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485756288 00000100:00100000:3.0:1788463369.613289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788463369.613295:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485756544:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788463369.613418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463369.613421:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463369.613594:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485756544:12345-0@lo:400:kworker.0 Request processed in 277us (2840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.613602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788463369.613620:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788463369.613627:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485757056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.613659:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485757056:12345-0@lo:400:kworker.0 Request processed in 34us (2862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.613677:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788463369.613690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788463369.613697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485756672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.613725:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485756672:12345-0@lo:400:kworker.0 Request processed in 30us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.613730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788463369.613740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788463369.613746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.613771:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485757184:12345-0@lo:400:kworker.0 Request processed in 26us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.613777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788463369.613788:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788463369.613794:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485755904:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788463369.615564:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f20380 x1875339485756672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463369.615611:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485756672:0@lo:400:kworker.0 00010000:00080000:0.0:1788463369.615629:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788443800 x1875339485757184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463369.615637:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485757184:0@lo:400:kworker.0 00000100:00100000:0.0:1788463369.615650:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485756544:0@lo:400:kworker.0 00000100:00100000:0.0:1788463369.615661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485757056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.617512:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485755904:12345-0@lo:400:kworker.0 Request processed in 3708us (6521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.617540:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788463369.617591:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788463369.617607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485756288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.617675:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485756288:12345-0@lo:400:kworker.0 Request processed in 77us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.617683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788463369.617718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485755776 00000100:00100000:3.0:1788463369.617726:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485755776 00000100:00100000:3.0:1788463369.617766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788463369.617773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485755776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463369.617842:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485755776:12345-0@lo:400:kworker.0 Request processed in 69us (6701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463369.617848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788463369.623898:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485755904:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.623941:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485755776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463369.623958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485756288:0@lo:400:kworker.0 00010000:00010000:2.0:1788463369.859727:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463370.119554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485757312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463370.119660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463370.120028:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757312 00000100:00100000:3.0:1788463370.120038:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757312 00000100:00100000:3.0:1788463370.120107:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788463370.120117:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485757312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463370.120153:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463370.120206:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485757312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463370.120214:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788463370.120259:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485757312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463370.627856:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485757440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463370.627934:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463370.628071:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757440 00000100:00100000:2.0:1788463370.628081:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757440 00000100:00100000:2.0:1788463370.628150:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788463370.628160:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485757440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463370.628209:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463370.633994:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485757440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5824us (6048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463370.634011:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788463370.637668:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485757440:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463370.883924:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463371.909200:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463372.542715:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463372.542759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463372.542786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463372.542816:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463372.542842:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463372.542872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790400 00000100:00100000:2.0:1788463372.542880:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790400 00000100:00100000:2.0:1788463372.542947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790656 00000100:00100000:2.0:1788463372.542951:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790656 00000100:00100000:2.0:1788463372.542969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790272 00000100:00100000:2.0:1788463372.542972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790272 00000100:00100000:2.0:1788463372.542984:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790528 00000100:00100000:2.0:1788463372.542987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790528 00000100:00100000:2.0:1788463372.543001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 235 00000100:00100000:2.0:1788463372.543011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466790400:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463372.543083:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466790400:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463372.543090:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 235 00000100:00100000:2.0:1788463372.543107:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 236 00000100:00100000:2.0:1788463372.543114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466790656:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463372.543155:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466790656:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463372.543162:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 236 00000100:00100000:2.0:1788463372.543181:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 237 00000100:00100000:2.0:1788463372.543188:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466790272:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463372.543214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466790272:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463372.543221:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 237 00000100:00100000:2.0:1788463372.543232:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 238 00000100:00100000:2.0:1788463372.543238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466790528:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463372.543259:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466790528:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463372.543265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 238 00000100:00080000:2.0:1788463372.543291:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463372.543296:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463372.543909:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790144 00000100:00100000:3.0:1788463372.543916:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790144 00000100:00100000:3.0:1788463372.543974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 342 00000100:00100000:3.0:1788463372.543983:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466790144:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463372.544031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466790144:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 49us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463372.544039:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 342 00010000:00010000:2.0:1788463372.931775:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463373.192839:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485757568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463373.192944:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463373.193059:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757568 00000100:00100000:3.0:1788463373.193070:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757568 00000100:00100000:3.0:1788463373.193158:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788463373.193186:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485757568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463373.193232:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463373.193313:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485757568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463373.193322:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788463373.193348:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463373.193391:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618843f1500 x1875339485757568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463373.193417:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485757568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463373.702180:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463373.702204:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463373.702279:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463373.702706:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757696 00000100:00100000:2.0:1788463373.702717:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757696 00000100:00100000:2.0:1788463373.702793:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463373.702804:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485757696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463373.702839:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463373.702888:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485757696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463373.702894:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788463373.703027:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463373.703057:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178844dc00 x1875339485757696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463373.703086:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485757696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463373.958650:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463374.724852:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.724930:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.724999:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485758464:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725024:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725046:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485758976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725067:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725092:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788463374.725098:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485757824:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725147:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485758336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725170:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725205:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485758848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725243:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725264:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759360:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725298:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.725331:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757952 00000100:00100000:1.0:1788463374.725339:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757952 00000100:00100000:1.0:1788463374.725380:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758464 00000100:00100000:1.0:1788463374.725384:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758464 00000100:00100000:1.0:1788463374.725422:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758976 00000100:00100000:1.0:1788463374.725425:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758976 00000100:00100000:1.0:1788463374.725454:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788463374.725464:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725518:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485757952:12345-0@lo:400:kworker.0 Request processed in 55us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463374.725526:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788463374.725546:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788463374.725552:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725612:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485758464:12345-0@lo:400:kworker.0 Request processed in 59us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463374.725618:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788463374.725630:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788463374.725636:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725662:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485758976:12345-0@lo:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463374.725667:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788463374.725689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758336 00000100:00100000:1.0:1788463374.725693:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758336 00000100:00100000:1.0:1788463374.725724:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463374.725729:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725763:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485758336:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463374.725769:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463374.725803:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485758336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725817:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725826:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485758464:0@lo:400:kworker.0 00000100:00100000:1.0:1788463374.725834:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485758976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726008:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758848 00000100:00100000:2.0:1788463374.726013:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758848 00000100:00100000:2.0:1788463374.726052:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759360 00000100:00100000:2.0:1788463374.726055:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759360 00000100:00100000:2.0:1788463374.726079:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463374.726087:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485758848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726135:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485758848:12345-0@lo:400:kworker.0 Request processed in 49us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726141:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463374.726154:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463374.726161:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726188:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759360:12345-0@lo:400:kworker.0 Request processed in 28us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726194:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463374.726227:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485758080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726256:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726276:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485758592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726298:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726314:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485759104:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726332:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726349:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788463374.726356:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485758208:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726376:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726405:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485758720:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726439:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485759232:0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726478:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.726503:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758592 00000100:00100000:2.0:1788463374.726506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758592 00000100:00100000:2.0:1788463374.726529:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759104 00000100:00100000:2.0:1788463374.726532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759104 00000100:00100000:2.0:1788463374.726554:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758208 00000100:00100000:2.0:1788463374.726557:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758208 00000100:00100000:2.0:1788463374.726568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788463374.726602:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485758592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485758592:12345-0@lo:400:kworker.0 Request processed in 64us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726645:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788463374.726656:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788463374.726662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485759104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485759104:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788463374.726702:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788463374.726708:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485758208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726731:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485758208:12345-0@lo:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726738:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788463374.726753:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758720 00000100:00100000:2.0:1788463374.726756:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758720 00000100:00100000:2.0:1788463374.726774:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759232 00000100:00100000:2.0:1788463374.726777:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759232 00000100:00100000:2.0:1788463374.726790:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463374.726796:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485758720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726823:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485758720:12345-0@lo:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726829:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463374.726838:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463374.726852:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485759232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463374.726881:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485759232:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.726886:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463374.726922:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485758208:0@lo:400:kworker.0 00010000:00080000:2.0:1788463374.726935:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788442680 x1875339485758720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463374.726943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485758720:0@lo:400:kworker.0 00010000:00080000:2.0:1788463374.726951:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788440380 x1875339485759232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463374.726958:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485759232:0@lo:400:kworker.0 00010000:00080000:2.0:1788463374.726967:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788440700 x1875339485758592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463374.726976:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485758592:0@lo:400:kworker.0 00010000:00080000:2.0:1788463374.726984:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788441180 x1875339485759104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463374.726991:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485759104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463374.727812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485757824 00000100:00100000:3.0:1788463374.727820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485757824 00000100:00100000:3.0:1788463374.727864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788463374.727872:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485757824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463374.727925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485757824:12345-0@lo:400:kworker.0 Request processed in 53us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463374.727932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788463374.727966:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485758080 00000100:00100000:3.0:1788463374.727970:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485758080 00000100:00100000:3.0:1788463374.727997:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788463374.728004:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485758080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463374.728044:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485758080:12345-0@lo:400:kworker.0 Request processed in 41us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463374.728050:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788463374.728091:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485758080:0@lo:400:kworker.0 00000100:00080000:0.0:1788463374.728522:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463374.728528:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463374.728531:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463374.728897:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463374.728943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463374.728987:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485757824:0@lo:400:kworker.0 00010000:00080000:1.0:1788463374.729005:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788442300 x1875339485758848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463374.729014:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485758848:0@lo:400:kworker.0 00010000:00080000:1.0:1788463374.729026:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788442a00 x1875339485759360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463374.729034:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463374.729178:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759488 00000100:00100000:0.0:1788463374.729196:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759488 00000100:00100000:0.0:1788463374.729240:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788463374.729249:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463374.729274:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463374.729320:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463374.729327:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1788463374.729354:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9e1f80 x1875339485759488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463374.729367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463374.732560:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485759616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463374.732676:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463374.732960:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759616 00000100:00100000:2.0:1788463374.732970:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759616 00000100:00100000:2.0:1788463374.733019:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463374.733028:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485759616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463374.733051:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463374.733105:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485759616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463374.733120:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788463374.733635:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178844d180 x1875339485759616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463374.733655:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485759616:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788463374.981026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463375.250856:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485759744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463375.250929:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463375.251733:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759744 00000100:00100000:0.0:1788463375.251743:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759744 00000100:00100000:0.0:1788463375.251791:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788463375.251801:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485759744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463375.251853:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463375.255874:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485759744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4063us (4933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463375.255892:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463375.261940:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485759744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463375.747886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463375.747925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463375.748008:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463375.748281:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485759872 00000100:00100000:2.0:1788463375.748290:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485759872 00000100:00100000:2.0:1788463375.748352:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788463375.748362:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463375.748399:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463375.748486:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485759872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463375.748493:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788463375.748952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485759872:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463376.003726:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463376.055225:0:13545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:22:54 (1788463374) === 00000100:00100000:2.0:1788463376.891085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463376.891183:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463376.891633:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790912 00000100:00100000:3.0:1788463376.891646:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790912 00000100:00100000:3.0:1788463376.891740:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463376.891752:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:68497686-852f-43ff-8be6-586d5980ece4+6:10516:x1875339466790912:12345-192.168.204.53@tcp:700:mkdir.0 00000100:00100000:3.0:1788463376.891834:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:68497686-852f-43ff-8be6-586d5980ece4+6:10516:x1875339466790912:12345-192.168.204.53@tcp:700:mkdir.0 Request processed in 85us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463376.891842:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00080000:1.0:1788463376.892125:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463376.892642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466790784 00000100:00100000:0.0:1788463376.892650:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466790784 00000100:00100000:0.0:1788463376.892716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:0.0:1788463376.892726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466790784:12345-192.168.204.53@tcp:41:mkdir.0 00000004:00000024:0.0:1788463376.892754:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463376.892825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466790784:12345-192.168.204.53@tcp:41:mkdir.0 Request processed in 100us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463376.892832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463376.899336:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463376.899433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791168 00000100:00100000:0.0:1788463376.899444:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791168 00000100:00100000:0.0:1788463376.899506:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:0.0:1788463376.899516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:10516:x1875339466791168:12345-192.168.204.53@tcp:36:mkdir.0 00010000:00010000:0.0:1788463376.899620:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463376.899708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765e7 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899739:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618c0095800) 00010000:00010000:0.0:1788463376.899752:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463376.899857:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899871:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899881:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899894:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899901:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.899908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900404:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900424:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900432:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463376.900448:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1055c4 reply state 0000000000721ef8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900458:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900464:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:0.0:1788463376.900467:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463376.900470:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788463376.900475:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788463376.900481:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900487:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900494:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900499:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463376.900504:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900511:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900529:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961884f9ba00) 00010000:00010000:0.0:1788463376.900531:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463376.900535:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900540:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a398a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463376.900555:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1055c4 reply state 0000000000721ef8 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900562:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463376.900569:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961884f9b300) 00010000:00010000:0.0:1788463376.900571:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463376.900625:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788463376.900716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+7:10516:x1875339466791168:12345-192.168.204.53@tcp:36:mkdir.0 Request processed in 1200us (1388us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788463376.900725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:1.0:1788463376.951891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463376.952053:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791296 00000100:00100000:2.0:1788463376.952063:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791296 00000100:00100000:2.0:1788463376.952131:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:2.0:1788463376.952143:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+7:10518:x1875339466791296:12345-192.168.204.53@tcp:101:chmod.0 00010000:00010000:2.0:1788463376.952165:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463376.952189:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47667a expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952253:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952269:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952302:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463376.952351:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463376.952355:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463376.952412:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952443:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47667a expref: 9 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952462:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47667a expref: 8 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463376.952470:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655800) 00010000:00010000:2.0:1788463376.952473:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463376.952476:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463376.952543:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+8:10518:x1875339466791296:12345-192.168.204.53@tcp:101:chmod.0 Request processed in 403us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463376.952550:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:2.0:1788463376.957806:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463376.957882:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791552 00000100:00100000:3.0:1788463376.957894:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791552 00000100:00100000:3.0:1788463376.957954:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:3.0:1788463376.957964:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+8:10518:x1875339466791552:12345-192.168.204.53@tcp:36:chmod.0 00010000:00010000:3.0:1788463376.958024:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463376.958054:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47667a expref: 8 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463376.958075:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655800) 00010000:00010000:3.0:1788463376.958087:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463376.958112:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463376.958125:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463376.958152:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463376.958366:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036aebf5a reply state 00000000df4cba8d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463376.958380:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463376.958398:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:3.0:1788463376.958401:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788463376.958404:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788463376.958412:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788463376.958500:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+9:10518:x1875339466791552:12345-192.168.204.53@tcp:36:chmod.0 Request processed in 538us (706us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788463376.958508:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00010000:00010000:3.0:1788463377.027877:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463377.031649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463377.033097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791680 00000100:00100000:1.0:1788463377.033110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791680 00000100:00100000:1.0:1788463377.033183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:1.0:1788463377.033194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+9:10520:x1875339466791680:12345-192.168.204.53@tcp:101:chown.0 00010000:00010000:1.0:1788463377.033218:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463377.033243:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a398ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476681 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033311:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033327:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033341:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463377.033394:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463377.033397:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463377.033436:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033462:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a398ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476681 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033499:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476681 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.033507:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:1.0:1788463377.033510:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463377.033513:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463377.033637:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+10:10520:x1875339466791680:12345-192.168.204.53@tcp:101:chown.0 Request processed in 445us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463377.033645:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:1.0:1788463377.042711:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.042920:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791808 00000100:00100000:2.0:1788463377.042931:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791808 00000100:00100000:2.0:1788463377.042998:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:2.0:1788463377.043008:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+10:10520:x1875339466791808:12345-192.168.204.53@tcp:101:chown.0 00010000:00010000:2.0:1788463377.043029:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463377.043050:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a398d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476688 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043127:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043141:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043153:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043165:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043172:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043178:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043270:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043278:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043284:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.043329:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463377.043332:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463377.043355:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043377:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043393:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043400:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043406:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.043410:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043418:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043430:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:2.0:1788463377.043433:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.043437:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043443:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a398df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043458:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043465:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043471:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043482:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.043485:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043491:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043499:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961884f9b300) 00010000:00010000:2.0:1788463377.043501:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.043504:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043509:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043534:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a398d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476688 expref: 12 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043548:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476688 expref: 11 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.043554:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:2.0:1788463377.043556:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463377.043559:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463377.043665:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+11:10520:x1875339466791808:12345-192.168.204.53@tcp:101:chown.0 Request processed in 659us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.043672:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:2.0:1788463377.055159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463377.055352:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466791936 00000100:00100000:0.0:1788463377.055363:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466791936 00000100:00100000:0.0:1788463377.055435:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463377.055446:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68497686-852f-43ff-8be6-586d5980ece4+11:10520:x1875339466791936:12345-192.168.204.53@tcp:900:chown.0 00000100:00100000:0.0:1788463377.055547:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:68497686-852f-43ff-8be6-586d5980ece4+11:10520:x1875339466791936:12345-192.168.204.53@tcp:900:chown.0 Request processed in 101us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463377.055555:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:1.0:1788463377.066693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.066790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466792192 00000100:00100000:2.0:1788463377.066801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466792192 00000100:00100000:2.0:1788463377.066872:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:2.0:1788463377.066882:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+11:10520:x1875339466792192:12345-192.168.204.53@tcp:36:chown.0 00010000:00010000:2.0:1788463377.066937:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463377.066964:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a398ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476688 expref: 11 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.066985:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:2.0:1788463377.066991:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463377.067012:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.067024:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.067033:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463377.070719:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788463377.071161:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcc919de reply state 00000000498b4038 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.071185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.071194:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:2.0:1788463377.071197:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788463377.071202:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788463377.071213:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788463377.071323:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788463377.071351:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+9:10520:x1875339466792192:12345-192.168.204.53@tcp:36:chown.0 Request processed in 4467us (4675us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788463377.071375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00010000:00010000:1.0:1788463377.071517:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071527:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071533:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071539:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463377.071543:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071551:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071562:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:1.0:1788463377.071570:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463377.071613:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463377.071621:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a398f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071762:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071775:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071781:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071786:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463377.071788:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071794:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071802:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961884f9b300) 00010000:00010000:0.0:1788463377.071805:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463377.071808:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071814:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a398a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071830:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071837:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071856:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071861:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463377.071870:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071877:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071886:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:0.0:1788463377.071888:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463377.071890:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071896:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071911:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071917:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071923:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071928:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463377.071931:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071937:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071945:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:0.0:1788463377.071947:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788463377.071956:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463377.071962:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a398c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463377.112324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463377.112425:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466792320 00000100:00100000:0.0:1788463377.112437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466792320 00000100:00100000:0.0:1788463377.112498:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:0.0:1788463377.112507:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:10521:x1875339466792320:12345-192.168.204.53@tcp:101:touch.500 00010000:00010000:0.0:1788463377.112529:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463377.112548:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47668f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788463377.115324:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2691us 00010000:00010000:2.0:1788463377.127874:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.127899:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.127913:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.127929:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.127936:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.127943:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128058:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128066:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128073:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.128117:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463377.128121:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463377.128173:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128186:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128193:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128199:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128205:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.128210:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128218:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128230:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:2.0:1788463377.128233:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.128237:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128244:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128255:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128262:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128268:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128280:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.128283:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128289:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128296:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961894655000) 00010000:00010000:2.0:1788463377.128299:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.128302:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128308:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39909 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128351:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a398fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47668f expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128367:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47668f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.128373:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.128376:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463377.128378:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21c00, rc 0) 00000100:00100000:2.0:1788463377.128468:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+7:10521:x1875339466792320:12345-192.168.204.53@tcp:101:touch.500 Request processed in 15960us (16154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.128477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:2.0:1788463377.133974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.134091:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466792576 00000100:00100000:3.0:1788463377.134101:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466792576 00000100:00100000:3.0:1788463377.134156:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:3.0:1788463377.134166:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+7:10521:x1875339466792576:12345-192.168.204.53@tcp:101:touch.500 00010000:00010000:3.0:1788463377.134186:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463377.134204:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39917 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476696 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134314:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134334:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134346:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134362:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134369:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.134376:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463377.135512:0:10067:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788463377.136042:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a3992c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136058:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a3992c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136067:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a3992c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136104:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136110:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136117:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136130:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463377.136134:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136142:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136154:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463377.136157:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463377.136161:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136167:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3991e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463377.136180:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000522626fb reply state 00000000757c1542 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136190:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136195:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffff96188d085600) 00010000:00010000:3.0:1788463377.136198:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463377.136201:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788463377.136239:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39917 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476696 expref: 10 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136255:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a3992c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476696 expref: 9 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.136273:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96188d085400) 00010000:00010000:3.0:1788463377.136275:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463377.136278:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f600, rc 0) 00000100:00100000:3.0:1788463377.136397:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+10:10521:x1875339466792576:12345-192.168.204.53@tcp:101:touch.500 Request processed in 2231us (2432us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788463377.136406:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463377.141394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.141472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466792832 00000100:00100000:2.0:1788463377.141484:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466792832 00000100:00100000:2.0:1788463377.141548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463377.141559:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+10:10521:x1875339466792832:12345-192.168.204.53@tcp:36:touch.500 00010000:00010000:2.0:1788463377.141654:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463377.141691:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a3992c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476696 expref: 10 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.141709:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff96188d085400) 00010000:00010000:2.0:1788463377.141719:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463377.141894:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.141907:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.141918:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463377.142014:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000983af542 reply state 00000000294e4b9c transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.142025:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.142031:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463377.142033:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463377.142035:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463377.142117:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+11:10521:x1875339466792832:12345-192.168.204.53@tcp:36:touch.500 Request processed in 560us (743us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788463377.142138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463377.149198:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.149287:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466792960 00000100:00100000:3.0:1788463377.149297:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466792960 00000100:00100000:3.0:1788463377.149357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:3.0:1788463377.149367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+11:10521:x1875339466792960:12345-192.168.204.53@tcp:101:touch.500 00010000:00010000:3.0:1788463377.149402:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463377.149423:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e600/0x841acb7f42a39941 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47669d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.149480:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e600/0x841acb7f42a39941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47669d expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.149494:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e600/0x841acb7f42a39941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47669d expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.149512:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463377.149515:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463377.149519:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00e600, rc 0) 00000100:00100000:3.0:1788463377.149567:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+12:10521:x1875339466792960:12345-192.168.204.53@tcp:101:touch.500 Request processed in 201us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463377.149618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:3.0:1788463377.153656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.153880:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793088 00000100:00100000:2.0:1788463377.153892:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793088 00000100:00100000:2.0:1788463377.153934:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:2.0:1788463377.153942:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466793088:12345-192.168.204.53@tcp:8:touch.500 00010000:00080000:2.0:1788463377.153974:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1788463377.154006:0:8441:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a39948 00002000:00100000:2.0:1788463377.154019:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68497686-852f-43ff-8be6-586d5980ece4/ffff9618c1ae4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788463377.154036:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788463377.154109:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788463377.154136:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9618c1ae5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463377.154207:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466793088:12345-192.168.204.53@tcp:8:touch.500 Request processed in 264us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.154215:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463377.158013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.158091:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793216 00000100:00100000:2.0:1788463377.158102:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793216 00000100:00100000:2.0:1788463377.158191:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:2.0:1788463377.158202:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466793216:12345-192.168.204.53@tcp:2:touch.500 00000100:00080000:1.0:1788463377.158456:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788463377.173912:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788463377.173930:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000100:00100000:2.0:1788463377.174610:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:0:x1875339466793216:12345-192.168.204.53@tcp:2:touch.500 Request processed in 16366us (16562us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788463377.174623:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463377.187842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.188348:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793472 00000100:00100000:3.0:1788463377.188360:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793472 00000100:00100000:3.0:1788463377.188559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463377.188572:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+12:10521:x1875339466793472:12345-192.168.204.53@tcp:35:touch.500 00000100:00100000:3.0:1788463377.188944:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+13:10521:x1875339466793472:12345-192.168.204.53@tcp:35:touch.500 Request processed in 375us (1112us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788463377.188953:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463377.232321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.233183:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793600 00000100:00100000:2.0:1788463377.233195:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793600 00000100:00100000:2.0:1788463377.233267:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463377.233293:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+13:10522:x1875339466793600:12345-192.168.204.53@tcp:101:rm.0 00010000:00010000:2.0:1788463377.233320:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463377.233342:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3994f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766a4 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233418:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233432:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233444:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.233484:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463377.233487:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463377.233542:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233566:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3994f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766a4 expref: 15 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233624:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766a4 expref: 14 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.233633:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.233636:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463377.233639:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463377.233698:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+14:10522:x1875339466793600:12345-192.168.204.53@tcp:101:rm.0 Request processed in 408us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.233717:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:1.0:1788463377.251341:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.251446:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793856 00000100:00100000:2.0:1788463377.251464:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793856 00000100:00100000:2.0:1788463377.251527:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:2.0:1788463377.251537:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+14:10522:x1875339466793856:12345-192.168.204.53@tcp:101:rm.0 00010000:00010000:2.0:1788463377.251557:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463377.251608:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3995d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766ab expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.251714:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788463377.251845:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3995d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ab expref: 16 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.251858:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:2.0:1788463377.251861:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463377.251866:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3995d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ab expref: 16 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.251880:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463377.252305:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+15:10522:x1875339466793856:12345-192.168.204.53@tcp:101:rm.0 Request processed in 768us (972us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788463377.252313:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:1.0:1788463377.261409:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463377.261975:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466793984 00000100:00100000:0.0:1788463377.261995:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466793984 00000100:00100000:0.0:1788463377.262060:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:0.0:1788463377.262195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+15:10522:x1875339466793984:12345-192.168.204.53@tcp:37:rm.0 00000100:00100000:2.0:1788463377.293527:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+15:10522:x1875339466793984:12345-192.168.204.53@tcp:37:rm.0 Request processed in 31325us (32117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.293552:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:2.0:1788463377.298968:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.299083:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466794240 00000100:00100000:3.0:1788463377.299093:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466794240 00000100:00100000:3.0:1788463377.299148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463377.299158:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+15:10522:x1875339466794240:12345-192.168.204.53@tcp:35:rm.0 00000100:00100000:3.0:1788463377.299398:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+16:10522:x1875339466794240:12345-192.168.204.53@tcp:35:rm.0 Request processed in 240us (439us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788463377.299406:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463377.304443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.304720:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466794496 00000100:00100000:2.0:1788463377.304730:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466794496 00000100:00100000:2.0:1788463377.304794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:2.0:1788463377.304804:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+16:10522:x1875339466794496:12345-192.168.204.53@tcp:101:rm.0 00010000:00010000:2.0:1788463377.304829:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463377.304849:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3996b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766b2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.304965:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39972 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.305266:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39972 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.305282:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39972 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.305295:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788463377.305551:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3996b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b2 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.305570:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39972 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b2 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.305754:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.305757:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463377.305761:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:2.0:1788463377.305829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466794496:12345-192.168.204.53@tcp:101:rm.0 Request processed in 1026us (1395us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788463377.305849:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:1.0:1788463377.319618:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.319720:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466794624 00000100:00100000:2.0:1788463377.319730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466794624 00000100:00100000:2.0:1788463377.319797:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:2.0:1788463377.319808:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466794624:12345-192.168.204.53@tcp:41:rm.0 00000004:00000024:2.0:1788463377.319867:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1788463377.319951:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466794624:12345-192.168.204.53@tcp:41:rm.0 Request processed in 145us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463377.319958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:1.0:1788463377.329622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.329842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466794752 00000100:00100000:3.0:1788463377.329853:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466794752 00000100:00100000:3.0:1788463377.329928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:3.0:1788463377.329939:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466794752:12345-192.168.204.53@tcp:101:rm.0 00010000:00010000:3.0:1788463377.329960:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463377.329988:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a39980 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766b9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330082:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330098:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330109:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330120:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330127:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330134:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330226:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330234:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330241:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463377.330273:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788463377.330277:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463377.330292:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330315:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330325:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330331:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330337:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330342:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463377.330347:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330354:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330365:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463377.330367:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463377.330371:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330388:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030c00/0x841acb7f42a39987 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330403:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330409:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330420:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330425:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463377.330428:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330434:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330440:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffff96188d085600) 00010000:00010000:3.0:1788463377.330443:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463377.330446:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330463:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961880030e00/0x841acb7f42a3998e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330489:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f600/0x841acb7f42a39980 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b9 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330500:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.330506:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463377.330508:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463377.330511:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf800, rc 0) 00000100:00100000:3.0:1788463377.330616:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+19:10522:x1875339466794752:12345-192.168.204.53@tcp:101:rm.0 Request processed in 679us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463377.330631:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:3.0:1788463377.338868:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.349424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795008 00000100:00100000:2.0:1788463377.349442:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795008 00000100:00100000:2.0:1788463377.349526:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:2.0:1788463377.349538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+19:10522:x1875339466795008:12345-192.168.204.53@tcp:36:rm.0 00010000:00010000:2.0:1788463377.349626:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788463377.349653:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349689:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e600/0x841acb7f42a39941 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47669d expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349703:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463377.349714:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39956 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766a4 expref: 17 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349724:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.349743:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463377.349767:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349780:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349789:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349800:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349806:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.349811:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350047:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350056:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350148:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463377.350388:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788463377.350399:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416801823726ns, next at 417801821269ns, rc = 0 00010000:00010000:2.0:1788463377.350453:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350474:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350481:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350487:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350493:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350507:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350535:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463377.350556:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350562:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350568:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350614:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.350619:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350627:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350648:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463377.350651:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788463377.350655:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.350662:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a399aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351412:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463377.351421:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351428:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463377.351432:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351440:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351460:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463377.351463:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788463377.351466:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351473:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a399b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463377.351489:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463377.351491:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463377.351492:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463377.351800:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351809:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351814:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351818:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.351821:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351827:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351835:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.351837:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.351840:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351845:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3999c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463377.351870:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f0bbd9e reply state 0000000059c9113f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.351883:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.352165:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffff96188d085600) 00010000:00010000:2.0:1788463377.352168:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463377.352171:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463377.352256:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466795008:12345-192.168.204.53@tcp:36:rm.0 Request processed in 2717us (13394us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788463377.352265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:1.0:1788463377.358688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463377.358727:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795264 00000100:00100000:3.0:1788463377.358739:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795264 00000100:00100000:3.0:1788463377.358799:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:3.0:1788463377.358810:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466795264:12345-192.168.204.53@tcp:35:rm.0 00000100:00100000:3.0:1788463377.359056:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+19:10522:x1875339466795264:12345-192.168.204.53@tcp:35:rm.0 Request processed in 247us (377us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788463377.359088:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:1.0:1788463377.363262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463377.363348:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795520 00000100:00100000:2.0:1788463377.363360:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795520 00000100:00100000:2.0:1788463377.363448:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:2.0:1788463377.363460:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+19:10522:x1875339466795520:12345-192.168.204.53@tcp:36:rm.0 00010000:00010000:2.0:1788463377.363520:0:12162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788463377.363547:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766b2 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363570:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47668f expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363630:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463377.363647:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a398d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476681 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363686:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618b7c44c00) 00010000:00010000:2.0:1788463377.363693:0:12162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463377.363717:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363729:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363739:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363750:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363756:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363761:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363838:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363847:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.363854:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463377.364117:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788463377.364132:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364145:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364152:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364158:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.364162:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364171:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364181:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff961894655100) 00010000:00010000:2.0:1788463377.364183:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788463377.364187:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364193:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813600/0x841acb7f42a399c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364215:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364221:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364227:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364233:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463377.364243:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364250:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364259:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:2.0:1788463377.364262:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463377.364265:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364271:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a399b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463377.364283:0:12162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001caa6798 reply state 00000000fa720fff transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364294:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463377.364301:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961894655b00) 00010000:00010000:2.0:1788463377.364304:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463377.364306:0:12162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463377.364397:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+18:10522:x1875339466795520:12345-192.168.204.53@tcp:36:rm.0 Request processed in 938us (1146us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788463377.364406:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:1.0:1788463377.655979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463377.656021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463377.656053:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463377.656130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463377.656218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795904 00000100:00100000:0.0:1788463377.656229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795904 00000100:00100000:0.0:1788463377.656295:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795776 00000100:00100000:0.0:1788463377.656299:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795776 00000100:00100000:0.0:1788463377.656312:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796032 00000100:00100000:0.0:1788463377.656314:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796032 00000100:00100000:0.0:1788463377.656330:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:0.0:1788463377.656338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466795904:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463377.656419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466795904:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 81us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463377.656426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:0.0:1788463377.656443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:0.0:1788463377.656461:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466795776:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463377.656487:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466795776:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463377.656494:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:0.0:1788463377.656506:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 247 00000100:00100000:0.0:1788463377.656512:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466796032:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463377.656534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466796032:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463377.656541:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 247 00000100:00100000:3.0:1788463377.656982:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466795648 00000100:00100000:3.0:1788463377.656989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466795648 00000100:00100000:3.0:1788463377.657033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 344 00000100:00100000:3.0:1788463377.657041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466795648:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463377.657081:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466795648:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463377.657088:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 344 00000100:00080000:1.0:1788463377.657305:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463377.657309:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463378.053050:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463378.308740:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463378.308763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485760000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463378.308829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463378.309427:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760000 00000100:00100000:0.0:1788463378.309437:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760000 00000100:00100000:0.0:1788463378.309513:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788463378.309525:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485760000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463378.309550:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463378.309629:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485760000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463378.309637:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788463378.311080:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463378.311137:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fbeed80 x1875339485760000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463378.311161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485760000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463378.819969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485760128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463378.820073:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463378.820225:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760128 00000100:00100000:0.0:1788463378.820248:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760128 00000100:00100000:0.0:1788463378.820333:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788463378.820346:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485760128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463378.820400:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463378.820462:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485760128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463378.820470:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788463378.820498:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463378.820535:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f21f80 x1875339485760128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463378.820558:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485760128:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788463378.822852:0:8830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418274272676ns, next at 419274269211ns, rc = 0 00010000:00010000:3.0:1788463379.077014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463379.846223:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463379.846254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485760384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485760512:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846515:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846601:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463379.846608:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485760896:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485761024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846715:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846784:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463379.846791:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485761408:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485761536:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.846915:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.846988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463379.846996:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485761920:0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.847037:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847676:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485760256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463379.847721:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847750:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485760768:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.847775:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847809:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485761280:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.847855:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847876:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485761792:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.847899:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847923:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788463379.847929:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485760640:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.847955:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.847976:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485761152:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.847998:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.848030:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485761664:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463379.848108:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760512 00000100:00100000:0.0:1788463379.848117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760512 00000100:00100000:0.0:1788463379.848170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761024 00000100:00100000:0.0:1788463379.848173:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761024 00000100:00100000:0.0:1788463379.848214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761536 00000100:00100000:0.0:1788463379.848218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761536 00000100:00100000:0.0:1788463379.848245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760768 00000100:00100000:0.0:1788463379.848248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760768 00000100:00100000:0.0:1788463379.848265:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761152 00000100:00100000:0.0:1788463379.848266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761152 00000100:00100000:0.0:1788463379.848279:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761664 00000100:00100000:0.0:1788463379.848281:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761664 00000100:00100000:0.0:1788463379.848302:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788463379.848311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485760512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848388:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485760512:12345-0@lo:400:kworker.0 Request processed in 78us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788463379.848430:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788463379.848436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485761024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848466:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485761024:12345-0@lo:400:kworker.0 Request processed in 30us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848473:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788463379.848484:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788463379.848490:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485761536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485761536:12345-0@lo:400:kworker.0 Request processed in 27us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788463379.848544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788463379.848559:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485760768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848626:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485760768:12345-0@lo:400:kworker.0 Request processed in 75us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848632:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788463379.848645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788463379.848651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485761152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848681:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485761152:12345-0@lo:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848687:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788463379.848699:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788463379.848705:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485761664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848731:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485761664:12345-0@lo:400:kworker.0 Request processed in 26us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848736:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788463379.848757:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760896 00000100:00100000:0.0:1788463379.848763:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760896 00000100:00100000:0.0:1788463379.848795:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760640 00000100:00100000:0.0:1788463379.848799:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760640 00000100:00100000:0.0:1788463379.848812:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463379.848817:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848852:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485760896:12345-0@lo:400:kworker.0 Request processed in 34us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848859:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463379.848871:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788463379.848877:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485760640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.848916:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485760640:12345-0@lo:400:kworker.0 Request processed in 40us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.848923:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788463379.848948:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761408 00000100:00100000:0.0:1788463379.848952:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761408 00000100:00100000:0.0:1788463379.848971:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761920 00000100:00100000:0.0:1788463379.848974:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761920 00000100:00100000:0.0:1788463379.848986:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761280 00000100:00100000:0.0:1788463379.848988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761280 00000100:00100000:0.0:1788463379.848996:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485761792 00000100:00100000:0.0:1788463379.848998:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485761792 00000100:00100000:0.0:1788463379.849011:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463379.849016:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485761408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849046:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485761408:12345-0@lo:400:kworker.0 Request processed in 30us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.849052:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463379.849061:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463379.849065:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485761920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849086:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485761920:12345-0@lo:400:kworker.0 Request processed in 20us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.849091:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788463379.849099:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463379.849104:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485761280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849125:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485761280:12345-0@lo:400:kworker.0 Request processed in 21us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.849130:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788463379.849138:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788463379.849149:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849172:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485761792:12345-0@lo:400:kworker.0 Request processed in 24us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463379.849178:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788463379.849207:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463379.849211:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463379.849213:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463379.849244:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485760640:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849258:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788404a80 x1875339485761152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849270:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485761152:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849279:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788406300 x1875339485761664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849286:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485761664:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849299:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485760768:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849309:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788405c00 x1875339485761280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849317:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485761280:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849326:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d0e00 x1875339485761792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849345:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485761792:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849390:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d1880 x1875339485761920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849412:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849427:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485761536:0@lo:400:kworker.0 00010000:00080000:0.0:1788463379.849437:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788404e00 x1875339485761408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463379.849445:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485761408:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485761024:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485760896:0@lo:400:kworker.0 00000100:00100000:0.0:1788463379.849477:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485760512:0@lo:400:kworker.0 00000100:00100000:3.0:1788463379.850105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760384 00000100:00100000:3.0:1788463379.850113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760384 00000100:00100000:3.0:1788463379.850155:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788463379.850162:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485760384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463379.850366:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485760256 00000100:00100000:1.0:1788463379.850371:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485760256 00000100:00100000:1.0:1788463379.850412:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788463379.850420:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485760256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463379.850451:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463379.850514:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485760256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463379.850522:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463379.851283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485760384:12345-0@lo:400:kworker.0 Request processed in 1108us (4894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463379.851293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788463379.852004:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485762048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463379.852257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463379.852306:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485760384:0@lo:400:kworker.0 00000100:00100000:2.0:1788463379.852888:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762048 00000100:00100000:2.0:1788463379.852897:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762048 00000100:00100000:2.0:1788463379.852971:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788463379.853170:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788405180 x1875339485760256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463379.853544:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485762048:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463379.856736:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485760256:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463379.856895:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463379.857930:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485762048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4387us (5667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463379.857945:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788463379.880743:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788440700 x1875339485762048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463379.880780:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485762048:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788463380.099901:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463380.360046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463380.360080:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485762176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463380.360179:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463380.360350:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762176 00000100:00100000:1.0:1788463380.360366:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762176 00000100:00100000:1.0:1788463380.360472:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788463380.360483:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485762176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463380.360524:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463380.360794:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485762176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463380.360919:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485762176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 436us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463380.360931:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788463380.876965:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485762304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463380.877092:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463380.877304:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762304 00000100:00100000:3.0:1788463380.877333:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762304 00000100:00100000:3.0:1788463380.877401:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463380.877410:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485762304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463380.877448:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463380.877503:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485762304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463380.877510:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463380.877558:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485762304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463381.126886:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463382.147921:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788463382.409890:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788463382.409938:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788463382.409949:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788463382.410601:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463382.410624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485762432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788463382.410724:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463382.411058:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411071:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411079:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411085:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00e800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463382.411091:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411099:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411115:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffff96188d085600) 00010000:00010000:1.0:1788463382.411118:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463382.411122:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411129:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00e800/0x841acb7f42a39925 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411148:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411164:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411169:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411186:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463382.411190:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411195:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411203:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463382.411205:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463382.411209:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411215:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3993a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411233:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411239:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411244:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411248:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463382.411256:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411262:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411269:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffff96188d085600) 00010000:00010000:1.0:1788463382.411272:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463382.411275:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411294:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a399a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411312:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411317:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411322:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411327:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463382.411329:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411335:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411342:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff961894655b00) 00010000:00010000:1.0:1788463382.411344:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463382.411353:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.411360:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813e00/0x841acb7f42a399bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463382.411507:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762432 00000100:00100000:3.0:1788463382.411516:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762432 00000100:00100000:3.0:1788463382.411610:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463382.411622:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485762432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788463382.411821:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788463382.411856:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a99c911, atime: 0x6a99c911, ctime: 0x6a99c911, blocks: 0x0 00010000:00010000:3.0:1788463382.411863:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463382.411879:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788463382.411884:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463382.411890:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463382.411907:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463382.411923:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463382.411932:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463382.411952:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788463382.412169:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fe19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485762432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 549us (1443us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788463382.412188:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788463382.412800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463382.413097:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463382.413106:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.413117:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463382.413121:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.413131:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.413151:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.413158:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f285b4f0/0x841acb7f42a399cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463382.413241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463382.413243:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463382.413244:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788463382.420455:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961787f21180/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788463382.420472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485762432:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788463382.766804:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766867:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766910:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766933:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463382.766959:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796544 00000100:00100000:1.0:1788463382.766969:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796544 00000100:00100000:1.0:1788463382.767024:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 90 00000100:00100000:1.0:1788463382.767033:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796544:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463382.767093:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796544:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463382.767101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 90 00000100:00100000:1.0:1788463382.767121:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796416 00000100:00100000:1.0:1788463382.767124:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796416 00000100:00100000:1.0:1788463382.767147:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796672 00000100:00100000:1.0:1788463382.767149:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796672 00000100:00100000:1.0:1788463382.767176:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796288 00000100:00100000:1.0:1788463382.767179:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796288 00000100:00100000:1.0:1788463382.767194:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796800 00000100:00100000:1.0:1788463382.767197:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796800 00000100:00100000:1.0:1788463382.767211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:1.0:1788463382.767217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796416:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463382.767247:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796416:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463382.767255:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:1.0:1788463382.767267:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00100000:1.0:1788463382.767283:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466796672:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463382.767309:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466796672:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 36us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463382.767326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00100000:0.0:1788463382.767650:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796160 00000100:00100000:0.0:1788463382.767656:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796160 00000100:00100000:0.0:1788463382.767686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 346 00000100:00100000:0.0:1788463382.767693:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466796160:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463382.767721:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466796160:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463382.767726:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 346 00000100:00100000:1.0:1788463382.767795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 256 00000100:00100000:1.0:1788463382.767804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796288:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463382.767835:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466796288:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 33us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463382.767841:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 256 00000100:00100000:0.0:1788463382.777558:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 257 00000100:00100000:0.0:1788463382.778542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466796800:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463382.778704:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466796800:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 173us (11768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463382.778713:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 257 00000100:00080000:0.0:1788463382.782610:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463382.782620:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463382.782624:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463383.172010:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463383.431125:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463383.431147:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485762560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463383.431216:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463383.432102:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762560 00000100:00100000:0.0:1788463383.432111:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762560 00000100:00100000:0.0:1788463383.432166:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788463383.432175:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485762560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463383.432219:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463383.432291:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485762560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463383.432298:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788463383.432328:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463383.432368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485762560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463383.940738:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463383.940768:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485762688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463383.940863:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463383.940952:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762688 00000100:00100000:0.0:1788463383.940962:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762688 00000100:00100000:0.0:1788463383.941022:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463383.941033:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485762688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463383.941066:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463383.941134:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485762688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463383.941142:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463383.941206:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485762688:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788463384.012188:0:13693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788463384.228356:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463384.964660:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485763200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.964744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.964800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485763712:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.964826:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.964845:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485764224:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.964881:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.964906:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788463384.964912:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485762816:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.964940:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.964963:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485763328:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.964987:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485763840:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965029:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965063:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485764352:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965082:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965110:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485763072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965133:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965150:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485763584:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965171:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965186:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485764096:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965204:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965222:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788463384.965238:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485762944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485763456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965314:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485763968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965332:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463384.965355:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763712 00000100:00100000:2.0:1788463384.965362:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763712 00000100:00100000:2.0:1788463384.965401:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764224 00000100:00100000:2.0:1788463384.965404:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764224 00000100:00100000:2.0:1788463384.965427:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763840 00000100:00100000:2.0:1788463384.965430:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763840 00000100:00100000:2.0:1788463384.965440:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764352 00000100:00100000:2.0:1788463384.965442:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764352 00000100:00100000:2.0:1788463384.965457:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788463384.965467:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485763712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965516:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485763712:12345-0@lo:400:kworker.0 Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965533:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788463384.965551:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463384.965558:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485764224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965613:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485764224:12345-0@lo:400:kworker.0 Request processed in 55us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965619:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463384.965631:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788463384.965637:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485763840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965660:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485763840:12345-0@lo:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965667:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788463384.965676:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788463384.965681:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485764352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965700:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485764352:12345-0@lo:400:kworker.0 Request processed in 20us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965706:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788463384.965726:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762816 00000100:00100000:2.0:1788463384.965729:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762816 00000100:00100000:2.0:1788463384.965753:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788463384.965758:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485762816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965783:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485762816:12345-0@lo:400:kworker.0 Request processed in 25us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788463384.965811:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763328 00000100:00100000:2.0:1788463384.965815:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763328 00000100:00100000:2.0:1788463384.965846:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763072 00000100:00100000:2.0:1788463384.965849:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763072 00000100:00100000:2.0:1788463384.965861:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788463384.965866:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485763328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965899:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485763328:12345-0@lo:400:kworker.0 Request processed in 33us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965904:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788463384.965915:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788463384.965921:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485763072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.965954:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485763072:12345-0@lo:400:kworker.0 Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.965959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788463384.965986:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763200 00000100:00100000:2.0:1788463384.965989:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763200 00000100:00100000:2.0:1788463384.966009:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763584 00000100:00100000:2.0:1788463384.966011:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763584 00000100:00100000:2.0:1788463384.966024:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764096 00000100:00100000:2.0:1788463384.966026:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764096 00000100:00100000:2.0:1788463384.966037:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485762944 00000100:00100000:2.0:1788463384.966039:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485762944 00000100:00100000:2.0:1788463384.966048:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763456 00000100:00100000:2.0:1788463384.966050:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763456 00000100:00100000:2.0:1788463384.966060:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485763968 00000100:00100000:2.0:1788463384.966062:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485763968 00000100:00100000:2.0:1788463384.966076:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788463384.966082:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485763200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966112:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485763200:12345-0@lo:400:kworker.0 Request processed in 31us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966118:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788463384.966136:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788463384.966142:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485763584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966175:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485763584:12345-0@lo:400:kworker.0 Request processed in 34us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966180:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788463384.966191:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788463384.966195:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485764096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966218:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485764096:12345-0@lo:400:kworker.0 Request processed in 23us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966224:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788463384.966247:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788463384.966253:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485762944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966282:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485762944:12345-0@lo:400:kworker.0 Request processed in 30us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966287:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788463384.966297:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788463384.966301:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485763456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966323:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485763456:12345-0@lo:400:kworker.0 Request processed in 22us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966329:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788463384.966339:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788463384.966344:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485763968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966370:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485763968:12345-0@lo:400:kworker.0 Request processed in 25us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463384.966376:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1788463384.966414:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463384.966419:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463384.966421:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463384.966424:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463384.966467:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485762944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485763456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966487:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485763968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966496:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485763072:0@lo:400:kworker.0 00010000:00080000:2.0:1788463384.966506:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787daf100 x1875339485763584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463384.966515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485763584:0@lo:400:kworker.0 00010000:00080000:2.0:1788463384.966523:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c1180 x1875339485764096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463384.966532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485764096:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966600:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485762816:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485763328:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966619:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485763840:0@lo:400:kworker.0 00010000:00080000:2.0:1788463384.966629:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c3b80 x1875339485764352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463384.966637:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485764352:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966649:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485763200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463384.966673:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485763712:0@lo:400:kworker.0 00010000:00080000:2.0:1788463384.966684:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d1c3480 x1875339485764224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463384.966692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485764224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463384.967534:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485764480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463384.967604:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463384.967650:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764480 00000100:00100000:0.0:1788463384.967656:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764480 00000100:00100000:1.0:1788463384.967902:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463384.967911:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485764608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463384.967939:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463384.968060:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764608 00000100:00100000:0.0:1788463384.968064:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764608 00000100:00100000:0.0:1788463384.968084:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463384.968091:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485764480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463384.968121:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463384.968170:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485764480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463384.968177:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463384.968207:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788463384.968213:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485764608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463384.968225:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463384.968262:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485764608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463384.968268:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788463384.970162:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d3480 x1875339485764608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463384.970187:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485764608:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788463384.970203:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788441f80 x1875339485764480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463384.970213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485764480:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788463385.221742:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463385.476462:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463385.476488:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485764736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463385.476603:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.477207:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485764736 00000100:00100000:0.0:1788463385.477216:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485764736 00000100:00100000:0.0:1788463385.477279:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463385.477288:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485764736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463385.477323:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463385.477390:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485764736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.477397:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463385.477876:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485764736:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788463385.783160:0:13741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe65ff4aa0 20000000:00000080:2.0:1788463385.783181:0:13741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961787eb1c00 uarg=0000000000000000 20000000:01000000:2.0:1788463385.783237:0:13741:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788463385.783244:0:13741:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788463385.783249:0:13741:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788463385.784171:0:13742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788463385.784410:0:13741:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788463385.790080:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788463385.790126:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788463385.790148:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788463385.790168:0:13741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463385.790188:0:13741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790208:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3985a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790230:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39868 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790237:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39876 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790245:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39884 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790274:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790282:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790290:0:13741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790409:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.790426:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 12 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.790441:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485764864:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463385.790995:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.791005:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 12 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.791014:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485764992:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463385.791050:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.791058:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 23 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.791081:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765120:0@lo:104: 00000100:00100000:2.0:1788463385.791123:0:13741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463385.791155:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.791164:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 23 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.791173:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765248:0@lo:104: 00010000:00010000:2.0:1788463385.791195:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.791202:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 23 pid: 6518 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.791224:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765376:0@lo:104: 00010000:00010000:2.0:1788463385.791251:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.791259:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 23 pid: 6516 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.791267:0:13741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765504:0@lo:104: 00000100:00100000:2.0:1788463385.791284:0:13741:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618918f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463385.791365:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788463385.791385:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.791419:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.791429:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.791438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765120 00000100:00100000:0.0:1788463385.791445:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765120 00000100:00100000:0.0:1788463385.791481:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765248 00000100:00100000:0.0:1788463385.791484:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765248 00000100:00100000:0.0:1788463385.791497:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765376 00000100:00100000:0.0:1788463385.791499:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765376 00000100:00100000:0.0:1788463385.791525:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765504 00000100:00100000:0.0:1788463385.791528:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765504 00000100:00100000:0.0:1788463385.791542:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463385.791551:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:13741:x1875339485765120:12345-0@lo:104: 00010000:00010000:0.0:1788463385.791601:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791657:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463385.791664:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+6:13741:x1875339485765120:12345-0@lo:104: Request processed in 114us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.791672:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463385.791711:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463385.791718:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:13741:x1875339485765248:12345-0@lo:104: 00010000:00010000:0.0:1788463385.791726:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791758:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463385.791763:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+5:13741:x1875339485765248:12345-0@lo:104: Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.791769:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463385.791781:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463385.791787:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:13741:x1875339485765376:12345-0@lo:104: 00010000:00010000:0.0:1788463385.791796:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791828:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463385.791834:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+4:13741:x1875339485765376:12345-0@lo:104: Request processed in 48us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.791840:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463385.791852:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463385.791859:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:13741:x1875339485765504:12345-0@lo:104: 00010000:00010000:0.0:1788463385.791873:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791904:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788463385.791910:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+3:13741:x1875339485765504:12345-0@lo:104: Request processed in 52us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.791916:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788463385.791936:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788463385.791941:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791949:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463385.791954:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.791963:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463385.791970:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463385.791975:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463385.792004:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792010:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463385.792030:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792037:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030800/0x841acb7f42a39884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3988b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792057:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463385.792060:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792065:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0ca00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463385.792068:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792074:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463385.792080:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463385.792085:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463385.792098:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792104:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463385.792119:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792125:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0ca00/0x841acb7f42a39876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3987d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792134:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463385.792136:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792152:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463385.792155:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792162:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463385.792167:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463385.792173:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463385.792186:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792192:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463385.792199:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792204:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a39868 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3986f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792231:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463385.792234:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792241:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463385.792244:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792261:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463385.792267:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463385.792273:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463385.792288:0:8455:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792293:0:8455:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463385.792299:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792306:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030a00/0x841acb7f42a3985a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a39861 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792319:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463385.792321:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463385.792323:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463385.792342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485766016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.792373:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.792395:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463385.792401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485765632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.792422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.792446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485765888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.792468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.792487:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463385.792499:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485765760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.792526:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463385.792550:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766016 00000100:00100000:0.0:1788463385.792555:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766016 00010000:00010000:0.0:1788463385.792597:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 24 pid: 6516 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463385.792618:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765632 00000100:00100000:0.0:1788463385.792622:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765632 00010000:00010000:0.0:1788463385.792633:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 25 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463385.792643:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765888 00000100:00100000:0.0:1788463385.792645:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765888 00010000:00010000:0.0:1788463385.792654:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 26 pid: 6518 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463385.792664:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485765760 00000100:00100000:0.0:1788463385.792666:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485765760 00010000:00010000:0.0:1788463385.792675:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 27 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463385.792686:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463385.792692:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3650:x1875339485766016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463385.792702:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463385.792707:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 27 pid: 6516 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792717:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 27 pid: 6516 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792743:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463385.792771:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+27:3650:x1875339485766016:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.792778:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463385.792791:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463385.792797:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+26:3650:x1875339485765632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463385.792805:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463385.792809:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 26 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792818:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 26 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792827:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463385.792849:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+26:3650:x1875339485765632:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.792855:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463385.792866:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463385.792872:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+25:3649:x1875339485765888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463385.792881:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463385.792885:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 25 pid: 6518 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792892:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 25 pid: 6518 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792901:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463385.792934:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+25:3649:x1875339485765888:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.792941:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463385.792953:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788463385.792959:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485765760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463385.792967:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463385.792971:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 24 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792979:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 24 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463385.792990:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463385.793011:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485765760:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463385.793017:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788463385.793052:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485765760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.793062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485765888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.793088:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485765632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463385.793096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485766016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463385.795733:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c800/0x841acb7f42a3988b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39884 expref: 23 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.795756:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765120:0@lo:104: 00010000:00010000:2.0:1788463385.795792:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20400/0x841acb7f42a3987d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39876 expref: 22 pid: 6517 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.795801:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765248:0@lo:104: 00010000:00010000:2.0:1788463385.795812:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21200/0x841acb7f42a3986f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a39868 expref: 21 pid: 6518 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.795820:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765376:0@lo:104: 00010000:00010000:2.0:1788463385.795830:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c600/0x841acb7f42a39861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3985a expref: 20 pid: 6516 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.795839:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485765504:0@lo:104: 00010000:00010000:0.0:1788463385.796027:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463385.796243:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463385.800267:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463385.800304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463385.800623:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466796928 00000100:00100000:3.0:1788463385.800633:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466796928 00010000:00010000:3.0:1788463385.800687:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 13 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463385.800725:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797056 00000100:00100000:3.0:1788463385.800728:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797056 00010000:00010000:3.0:1788463385.800744:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 14 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463385.800765:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463385.800775:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afa1ff74-abed-45cf-941d-a3a930cb8d12+14:2400:x1875339466796928:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463385.800805:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463385.800811:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 14 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800823:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 14 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800846:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463385.800901:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afa1ff74-abed-45cf-941d-a3a930cb8d12+14:2400:x1875339466796928:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 127us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463385.800909:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463385.800928:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:3.0:1788463385.800935:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466797056:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463385.800943:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463385.800948:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 13 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800958:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 13 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800970:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800979:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.800996:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801015:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801022:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801030:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801036:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463385.801041:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801050:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801060:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463385.801071:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463385.801092:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466797056:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 157us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463385.801098:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00010000:00010000:2.0:1788463385.803025:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d600/0x841acb7f42a39899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476673 expref: 12 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.803048:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485764864:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463385.803066:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880031400/0x841acb7f42a39892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47666c expref: 11 pid: 6516 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463385.803075:0:13741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787b5ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1875339485764992:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463385.803125:0:13741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.803136:0:13741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.803142:0:13741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463385.803172:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813600/0x841acb7f42a399d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463385.991358:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463385.991382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485766144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463385.991461:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463385.991541:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766144 00000100:00100000:3.0:1788463385.991549:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766144 00000100:00100000:3.0:1788463385.991620:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788463385.991640:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485766144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463385.991691:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463385.993247:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485766144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463385.993267:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788463385.993351:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485766144:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463386.256078:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463386.784691:0:13790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd13cec9d0 20000000:00000080:2.0:1788463386.784720:0:13790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff961787eb1c00 uarg=0000000000000000 20000000:01000000:2.0:1788463386.784766:0:13790:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788463386.784772:0:13790:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788463386.784778:0:13790:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788463386.791935:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788463386.792931:0:13790:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788463386.793056:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788463386.793094:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788463386.793110:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788463386.793123:0:13790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788463386.793144:0:13790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793161:0:13790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793171:0:13790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793178:0:13790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793185:0:13790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793205:0:13790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793212:0:13790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfa00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463386.793232:0:13790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793241:0:13790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793255:0:13790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793264:0:13790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.793270:0:13790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdfa00/0x841acb7f42a399db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463386.948843:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463386.948850:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f993000 from 7 10000000:01000000:2.0:1788463386.948854:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463386.948903:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463386.948916:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463386.948929:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463386.948956:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463386.949027:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463386.949095:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.949678:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766272 00000100:00100000:0.0:1788463386.949687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766272 00000100:00100000:0.0:1788463386.949737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788463386.949748:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:6520:x1875339485766272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463386.949763:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463386.949785:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4400/0x841acb7f42a399e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a399e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.949819:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4400/0x841acb7f42a399e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a399e2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.949831:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4400/0x841acb7f42a399e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a399e2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.949840:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4400, rc 0) 00000100:00100000:0.0:1788463386.949892:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.949899:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788463386.950027:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787dadc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463386.950043:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.950053:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463386.950119:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463386.950147:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463386.950167:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.950212:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766400 00000100:00100000:0.0:1788463386.950216:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766400 00000100:00100000:0.0:1788463386.950269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788463386.950276:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.950436:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.950443:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788463386.956116:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.956206:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.956291:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.956376:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463386.956616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766528 00000100:00100000:2.0:1788463386.956624:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766528 00000100:00100000:2.0:1788463386.956727:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788463386.956738:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463386.956960:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463386.956968:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788463386.957093:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.957758:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13801:1875339485766656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463386.957903:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.957929:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463386.958096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766656 00000100:00100000:2.0:1788463386.958103:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766656 00000100:00100000:2.0:1788463386.958139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788463386.958148:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:13801:x1875339485766656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463386.958260:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:13801:x1875339485766656:12345-0@lo:502:llog_process_th.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463386.958268:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788463386.958362:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13801:1875339485766656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463386.958463:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463386.958474:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463386.958477:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463386.958708:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188f993000 00000020:00000080:0.0:1788463386.958712:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463386.958777:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463386.958780:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463386.958781:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463386.958785:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463386.958787:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463386.958789:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788463386.958791:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188f993000 00000020:00000080:0.0:1788463386.958793:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788463386.961001:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13801:1875339485766784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463386.961088:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.961144:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463386.961219:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766784 00000100:00100000:3.0:1788463386.961227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766784 00000100:00100000:3.0:1788463386.963963:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788463386.963989:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:13801:x1875339485766784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463386.964217:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:13801:x1875339485766784:12345-0@lo:502:llog_process_th.0 Request processed in 237us (3128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463386.964226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788463386.964406:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13801:1875339485766784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463386.964448:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463386.964458:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463386.964461:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788463386.964465:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788463386.965884:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788463386.965920:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463386.965932:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.965944:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463386.965956:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463386.965959:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188f7d1000 from 7 10000000:01000000:1.0:1788463386.965962:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463386.965997:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.966006:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.966018:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463386.966043:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463386.966101:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463386.976311:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.978620:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485766912 00000100:00100000:0.0:1788463386.978637:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485766912 00000100:00100000:1.0:1788463386.978753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788463386.978765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:6520:x1875339485766912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463386.978792:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463386.978811:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0c000/0x841acb7f42a399f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a399f0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.978841:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c000/0x841acb7f42a399f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a399f0 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.978853:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0c000/0x841acb7f42a399f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a399f0 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463386.978862:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c000, rc 0) 00000100:00100000:1.0:1788463386.978954:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485766912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (12852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463386.978962:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788463386.979100:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485766912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463386.979120:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.979132:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463386.979228:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.979274:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.979308:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.979321:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767040 00000100:00100000:0.0:1788463386.979325:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767040 00000100:00100000:0.0:1788463386.979344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788463386.979349:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485767040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.979457:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485767040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.979478:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788463386.979506:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.979673:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.979721:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.979738:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.979755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767168 00000100:00100000:0.0:1788463386.979758:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767168 00000100:00100000:0.0:1788463386.979783:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788463386.979791:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485767168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.979960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485767168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.979968:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788463386.980088:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463386.985972:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13804:1875339485767296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463386.986159:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463386.986375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767296 00000100:00100000:2.0:1788463386.986452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767296 00000100:00100000:3.0:1788463386.986471:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463386.986676:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788463386.986687:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:13804:x1875339485767296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463386.986844:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:13804:x1875339485767296:12345-0@lo:502:llog_process_th.0 Request processed in 160us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463386.986852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788463386.989269:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13804:1875339485767296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463386.989331:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463386.989344:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463386.989347:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463386.989363:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188f7d1000 00000020:00000080:3.0:1788463386.989367:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463386.990676:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463386.990684:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463386.990687:0:13804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788463386.990696:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463386.990701:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463386.990703:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788463386.990708:0:13804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188f7d1000 00000020:00000080:3.0:1788463386.990711:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788463386.990776:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13804:1875339485767424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463386.990872:0:13804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463386.990910:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.991375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767424 00000100:00100000:0.0:1788463386.991386:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767424 00000100:00100000:0.0:1788463386.991451:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788463386.991460:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:13804:x1875339485767424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463386.991817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:13804:x1875339485767424:12345-0@lo:502:llog_process_th.0 Request processed in 355us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.991834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788463386.992268:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13804:1875339485767424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463386.992305:0:13804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463386.992320:0:13804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463386.992322:0:13804:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788463386.992331:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788463386.993915:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788463386.993955:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463386.993968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.993981:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463386.993992:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788463386.993996:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188d0ea000 from 7 10000000:01000000:0.0:1788463386.993999:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463386.994036:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.994044:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.994056:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463386.994080:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.994146:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.994210:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463386.995133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767552 00000100:00100000:3.0:1788463386.995145:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767552 00000100:00100000:3.0:1788463386.995221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788463386.995233:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:6520:x1875339485767552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463386.995250:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463386.995267:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde600/0x841acb7f42a39a05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a399fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.995295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde600/0x841acb7f42a39a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a399fe expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.995308:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde600/0x841acb7f42a39a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a399fe expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463386.995317:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde600, rc 0) 00000100:00100000:3.0:1788463386.995380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485767552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463386.995469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788463386.996653:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463386.996680:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463386.996692:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463386.996893:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.996944:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.996981:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.996999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767680 00000100:00100000:0.0:1788463386.997004:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767680 00000100:00100000:0.0:1788463386.997040:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788463386.997049:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485767680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.997170:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485767680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.997178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788463386.997218:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.997247:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.997287:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463386.997301:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463386.997315:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767808 00000100:00100000:0.0:1788463386.997318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767808 00000100:00100000:0.0:1788463386.997333:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788463386.997338:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485767808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463386.997402:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485767808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463386.997408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788463386.997434:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485767808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.026781:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13806:1875339485767936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.026873:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.026916:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485767936 00000100:00100000:1.0:1788463387.026924:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485767936 00000100:00100000:1.0:1788463387.026971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788463387.026980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:13806:x1875339485767936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.027101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:13806:x1875339485767936:12345-0@lo:502:llog_process_th.0 Request processed in 120us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.027109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788463387.027163:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.027198:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13806:1875339485767936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463387.027229:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463387.027239:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.027246:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463387.027254:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188d0ea000 00000020:00000080:1.0:1788463387.027257:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463387.027316:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463387.028019:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.028023:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463387.028029:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463387.028033:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.028034:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788463387.028038:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188d0ea000 00000020:00000080:1.0:1788463387.028041:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788463387.032017:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13806:1875339485768064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.032112:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.032161:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768064 00000100:00100000:1.0:1788463387.032169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768064 00000100:00100000:1.0:1788463387.032229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788463387.032239:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:13806:x1875339485768064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.032371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:13806:x1875339485768064:12345-0@lo:502:llog_process_th.0 Request processed in 132us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.032379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788463387.032434:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.032460:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13806:1875339485768064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463387.034784:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463387.034799:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.034801:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788463387.034806:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788463387.035870:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788463387.035912:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463387.035925:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.035937:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463387.035948:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463387.035951:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9618850d0800 from 7 10000000:01000000:2.0:1788463387.035967:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463387.037693:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.038606:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.038623:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463387.038656:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463387.038874:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463387.038933:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884fbe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.040889:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768192 00000100:00100000:1.0:1788463387.040904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768192 00000100:00100000:1.0:1788463387.040959:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788463387.040978:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:6520:x1875339485768192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463387.040999:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463387.041021:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0ce00/0x841acb7f42a39a13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a39a0c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.041054:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0ce00/0x841acb7f42a39a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a39a0c expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.041067:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0ce00/0x841acb7f42a39a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a39a0c expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.041078:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ce00, rc 0) 00000100:00100000:1.0:1788463387.041157:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485768192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.041165:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788463387.041254:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463387.041274:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.041284:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463387.041364:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.041398:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.041427:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.041440:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768320 00000100:00100000:1.0:1788463387.041444:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768320 00000100:00100000:1.0:1788463387.041469:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788463387.041485:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485768320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.041664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485768320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.041673:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788463387.041712:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.041743:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.041785:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.041804:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618811ca840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.041815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768448 00000100:00100000:1.0:1788463387.041819:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768448 00000100:00100000:1.0:1788463387.041841:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788463387.041848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485768448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.041944:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:6520:x1875339485768448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.041951:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788463387.042000:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:760a69d7-d23f-4a71-8b75-cca21d577f9e:6520:1875339485768448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.042231:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13809:1875339485768576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.042276:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.042307:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768576 00000100:00100000:1.0:1788463387.042311:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768576 00000100:00100000:1.0:1788463387.042341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788463387.042349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:13809:x1875339485768576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.042436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:13809:x1875339485768576:12345-0@lo:502:llog_process_th.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.042453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788463387.042490:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.042503:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13809:1875339485768576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463387.042525:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463387.042533:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.042536:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463387.042542:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618850d0800 00000020:00000080:1.0:1788463387.042545:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463387.042624:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463387.042910:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.042913:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463387.042917:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463387.042920:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.042922:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788463387.042927:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9618850d0800 00000020:00000080:1.0:1788463387.042929:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788463387.043107:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13809:1875339485768704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.043151:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463387.043175:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768704 00000100:00100000:1.0:1788463387.043180:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768704 00000100:00100000:1.0:1788463387.043218:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788463387.043225:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:13809:x1875339485768704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463387.043303:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:13809:x1875339485768704:12345-0@lo:502:llog_process_th.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.043310:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788463387.043350:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b219c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463387.043364:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:760a69d7-d23f-4a71-8b75-cca21d577f9e:13809:1875339485768704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463387.043392:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463387.043396:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463387.043398:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788463387.043401:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788463387.043458:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788463387.043478:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463387.043488:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.043498:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463387.054288:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788463387.098342:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463387.267822:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463387.571126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.571274:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797184 00000100:00100000:1.0:1788463387.571285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797184 00000100:00100000:1.0:1788463387.571355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 368 00000100:00100000:1.0:1788463387.571367:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:6174:x1875339466797184:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463387.571522:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463387.571553:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d400/0x841acb7f42a39a1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766c0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.571619:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d400/0x841acb7f42a39a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.571632:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d400/0x841acb7f42a39a1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463387.571643:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d400, rc 0) 00000100:00100000:1.0:1788463387.571721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b3278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797184:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 356us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.571749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 368 00000100:00100000:3.0:1788463387.574520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.574723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797312 00000100:00100000:1.0:1788463387.574734:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797312 00000100:00100000:1.0:1788463387.574799:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 369 00000100:00100000:1.0:1788463387.574810:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797312:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.575390:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797312:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 579us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.575400:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 369 00000100:00100000:3.0:1788463387.579443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.579931:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797440 00000100:00100000:1.0:1788463387.579942:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797440 00000100:00100000:1.0:1788463387.580011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 370 00000100:00100000:1.0:1788463387.580023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797440:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.580403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797440:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 381us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.580412:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 370 00000100:00100000:3.0:1788463387.586018:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.586654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797568 00000100:00100000:1.0:1788463387.586665:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797568 00000100:00100000:1.0:1788463387.586724:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 371 00000100:00100000:1.0:1788463387.586735:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:10808:x1875339466797568:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463387.586899:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:10808:x1875339466797568:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 165us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.586907:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 371 00000100:00100000:0.0:1788463387.606743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.607387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797696 00000100:00100000:1.0:1788463387.607399:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797696 00000100:00100000:1.0:1788463387.607496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 372 00000100:00100000:1.0:1788463387.607506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:10808:x1875339466797696:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463387.607699:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:10808:x1875339466797696:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 194us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.607708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 372 00000100:00100000:3.0:1788463387.620123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463387.620482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797824 00000100:00100000:2.0:1788463387.620494:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797824 00000100:00100000:2.0:1788463387.620563:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 373 00000100:00100000:2.0:1788463387.620613:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:6174:x1875339466797824:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463387.620631:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463387.620649:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813e00/0x841acb7f42a39a21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766c7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.620680:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813e00/0x841acb7f42a39a21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c7 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.620692:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813e00/0x841acb7f42a39a21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c7 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463387.620703:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813e00, rc 0) 00000100:00100000:2.0:1788463387.620756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466797824:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 184us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.620783:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 373 00000100:00100000:3.0:1788463387.631649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463387.632011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466797952 00000100:00100000:2.0:1788463387.632022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466797952 00000100:00100000:2.0:1788463387.632314:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 374 00000100:00100000:2.0:1788463387.632327:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466797952:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463387.632509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466797952:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 184us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.632517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 374 00000100:00100000:0.0:1788463387.642560:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.642861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798080 00000100:00100000:1.0:1788463387.642873:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798080 00000100:00100000:1.0:1788463387.642925:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 375 00000100:00100000:1.0:1788463387.642935:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466798080:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463387.643115:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:6174:x1875339466798080:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 180us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.643124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 375 00000100:00100000:0.0:1788463387.648956:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463387.651089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798208 00000100:00100000:2.0:1788463387.651105:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798208 00000100:00100000:2.0:1788463387.651593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 376 00000100:00100000:2.0:1788463387.651609:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:10811:x1875339466798208:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463387.651781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:10811:x1875339466798208:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 177us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.651791:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 376 00000100:00100000:3.0:1788463387.662725:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463387.662859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798336 00000100:00100000:1.0:1788463387.662954:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798336 00000100:00100000:1.0:1788463387.663024:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 377 00000100:00100000:1.0:1788463387.663033:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:10811:x1875339466798336:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463387.665023:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:10811:x1875339466798336:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 1980us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463387.665037:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 377 00000100:00100000:0.0:1788463387.886188:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886346:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886395:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463387.886425:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798848 00000100:00100000:0.0:1788463387.886436:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798848 00000100:00100000:0.0:1788463387.886497:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 95 00000100:00100000:0.0:1788463387.886508:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798848:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463387.886611:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798848:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463387.886619:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 95 00000100:00100000:2.0:1788463387.887004:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798720 00000100:00100000:2.0:1788463387.887010:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798720 00000100:00100000:2.0:1788463387.887054:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798976 00000100:00100000:2.0:1788463387.887057:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798976 00000100:00100000:2.0:1788463387.887072:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798592 00000100:00100000:2.0:1788463387.887074:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798592 00000100:00100000:2.0:1788463387.887090:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799104 00000100:00100000:2.0:1788463387.887092:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799104 00000100:00100000:2.0:1788463387.887106:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 264 00000100:00100000:2.0:1788463387.887113:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798720:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463387.887151:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798720:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.887182:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 264 00000100:00100000:2.0:1788463387.887198:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 265 00000100:00100000:2.0:1788463387.887216:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466798976:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463387.887244:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466798976:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.887250:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 265 00000100:00100000:2.0:1788463387.887262:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 266 00000100:00100000:2.0:1788463387.887268:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798592:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463387.887296:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466798592:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.887301:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 266 00000100:00100000:2.0:1788463387.887312:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 267 00000100:00100000:2.0:1788463387.887318:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466799104:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463387.887342:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466799104:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.887349:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 267 00000100:00080000:2.0:1788463387.887370:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463387.887374:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463387.887377:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463387.887389:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466798464 00000100:00100000:2.0:1788463387.887393:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466798464 00000100:00100000:2.0:1788463387.887420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 378 00000100:00100000:2.0:1788463387.887427:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466798464:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463387.887452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466798464:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463387.887476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 378 00000040:00080000:0.0:1788463388.103476:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788463388.104991:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463388.292657:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463388.547886:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463388.547915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485768832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463388.547992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463388.548070:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768832 00000100:00100000:3.0:1788463388.548077:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768832 00000100:00100000:3.0:1788463388.548137:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463388.548147:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485768832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463388.548187:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463388.548231:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485768832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00080000:2.0:1788463388.548398:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463388.548460:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485768832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463388.548565:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000001:00080000:0.0:1788463388.551920:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788463389.060359:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463389.060383:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485768960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463389.060456:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463389.060609:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485768960 00000100:00100000:3.0:1788463389.060616:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485768960 00000100:00100000:3.0:1788463389.060703:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788463389.060713:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485768960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463389.060738:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463389.060789:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485768960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463389.060797:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788463389.060846:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788463389.060852:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961787f21180, transno 4294967301 00000100:00100000:3.0:1788463389.060871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485768960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463389.061937:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463389.317391:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463390.084028:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463390.084054:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485769088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463390.084144:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463390.084651:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769088 00000100:00100000:1.0:1788463390.084660:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769088 00000100:00100000:1.0:1788463390.084735:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788463390.084747:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485769088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463390.084780:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463390.084840:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485769088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463390.084848:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788463390.084938:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485769216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463390.084970:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788463390.085027:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d3b80 x1875339485769088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463390.085046:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485769088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463390.085181:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769216 00000100:00100000:2.0:1788463390.085186:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769216 00000100:00100000:2.0:1788463390.085303:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788463390.085311:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485769216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463390.085322:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463390.085357:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485769216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463390.085362:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1788463390.085389:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788404380 x1875339485769216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463390.085401:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485769216:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788463390.085763:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463390.086383:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485769344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463390.086432:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463390.086614:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769344 00000100:00100000:2.0:1788463390.086632:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769344 00000100:00100000:2.0:1788463390.086671:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788463390.086680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485769344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.086748:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485769472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.086782:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.089486:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769472 00000100:00100000:0.0:1788463390.089502:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769472 00000100:00100000:0.0:1788463390.089590:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788463390.089601:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485769472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.089742:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485769472:12345-0@lo:400:kworker.0 Request processed in 142us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.089750:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788463390.089805:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485769472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.089902:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485769600:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.089973:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090013:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485770112:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.090033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485769984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090042:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090070:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485770624:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.090076:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463390.090104:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485770496:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090105:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463390.090149:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485769728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.090154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090182:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090202:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485770240:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090224:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090264:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769600 00000100:00100000:0.0:1788463390.090269:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769600 00000100:00100000:0.0:1788463390.090298:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788463390.090305:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485769600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.090337:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788463390.090346:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485769856:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090353:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485769600:12345-0@lo:400:kworker.0 Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090361:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463390.090380:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770112 00000100:00100000:0.0:1788463390.090387:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770112 00000100:00100000:1.0:1788463390.090402:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485770368:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090419:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769984 00000100:00100000:1.0:1788463390.090428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.090432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769984 00000100:00100000:0.0:1788463390.090456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770624 00000100:00100000:0.0:1788463390.090459:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770624 00000100:00100000:1.0:1788463390.090464:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770240 00000100:00100000:1.0:1788463390.090470:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770240 00000100:00100000:0.0:1788463390.090478:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770496 00000100:00100000:0.0:1788463390.090483:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770496 00000100:00100000:0.0:1788463390.090503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769728 00000100:00100000:0.0:1788463390.090506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769728 00000100:00100000:0.0:1788463390.090518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788463390.090523:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485770112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090555:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485770112:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788463390.090572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788463390.090609:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485769984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090643:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485769984:12345-0@lo:400:kworker.0 Request processed in 36us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788463390.090660:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788463390.090666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485770624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090688:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485770624:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788463390.090702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788463390.090708:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090731:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485770496:12345-0@lo:400:kworker.0 Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788463390.090755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788463390.090760:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485769728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090789:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485769728:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.090795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1788463390.090814:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463390.090820:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463390.090822:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463390.090848:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485769728:0@lo:400:kworker.0 00010000:00080000:0.0:1788463390.090863:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178844df80 x1875339485770624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463390.090873:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485770624:0@lo:400:kworker.0 00010000:00080000:0.0:1788463390.090882:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d0e00 x1875339485770112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463390.090890:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485770112:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.090899:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485769600:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.092346:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770368 00000100:00100000:1.0:1788463390.092360:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770368 00000100:00100000:1.0:1788463390.092407:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463390.092417:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485770240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.092490:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485770240:12345-0@lo:400:kworker.0 Request processed in 75us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463390.092497:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463390.092628:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463390.092636:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485770368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.092681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485770240:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.092689:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485770368:12345-0@lo:400:kworker.0 Request processed in 54us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463390.092697:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463390.092921:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485770368:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.092923:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485769856 00000100:00100000:0.0:1788463390.092930:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485769856 00000100:00100000:1.0:1788463390.092943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485769984:0@lo:400:kworker.0 00000100:00100000:1.0:1788463390.092961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485770496:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.092969:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788463390.092979:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.093045:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485769856:12345-0@lo:400:kworker.0 Request processed in 67us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463390.093054:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485769856:0@lo:400:kworker.0 00000100:00100000:0.0:1788463390.093054:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788463390.093553:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485769344:12345-0@lo:400:kworker.0 Request processed in 6871us (7116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463390.093562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788463390.095875:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485769344:0@lo:400:kworker.0 00010000:00010000:0.0:1788463390.352795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463390.598514:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463390.598538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485770752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463390.598634:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463390.598934:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770752 00000100:00100000:0.0:1788463390.598944:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770752 00000100:00100000:0.0:1788463390.598996:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463390.599007:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485770752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463390.599048:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788463390.599186:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485770752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463390.599205:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788463390.603803:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485770752:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463391.108074:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463391.108099:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485770880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463391.108184:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.108427:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485770880 00000100:00100000:0.0:1788463391.108437:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485770880 00000100:00100000:0.0:1788463391.108492:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463391.108501:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485770880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463391.108536:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463391.108614:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485770880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.108621:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788463391.108716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485770880:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463391.371504:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463392.389404:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463393.016208:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463393.016266:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463393.016300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463393.016365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463393.016405:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799360 00000100:00100000:0.0:1788463393.016416:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799360 00000100:00100000:0.0:1788463393.016483:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799488 00000100:00100000:0.0:1788463393.016487:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799488 00000100:00100000:0.0:1788463393.016502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799744 00000100:00100000:0.0:1788463393.016505:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799744 00000100:00100000:0.0:1788463393.016523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 274 00000100:00100000:0.0:1788463393.016544:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466799360:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463393.016655:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466799360:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 111us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463393.016664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 274 00000100:00100000:0.0:1788463393.016698:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 275 00000100:00100000:0.0:1788463393.016705:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466799488:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463393.016733:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466799488:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463393.016740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 275 00000100:00100000:0.0:1788463393.016752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 276 00000100:00100000:0.0:1788463393.016757:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466799744:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463393.016780:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466799744:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463393.016785:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 276 00000100:00080000:0.0:1788463393.016803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463393.016808:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463393.019024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463393.019090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463393.019122:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799872 00000100:00100000:3.0:1788463393.019131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799872 00000100:00100000:3.0:1788463393.019190:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 277 00000100:00100000:3.0:1788463393.019199:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466799872:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463393.019268:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466799872:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463393.019276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 277 00000100:00080000:3.0:1788463393.019297:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463393.019786:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799616 00000100:00100000:0.0:1788463393.019792:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799616 00000100:00100000:0.0:1788463393.019841:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 98 00000100:00100000:0.0:1788463393.019849:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466799616:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463393.019890:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466799616:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463393.019897:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 98 00000100:00080000:3.0:1788463393.020322:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463393.020962:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466799232 00000100:00100000:1.0:1788463393.020972:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466799232 00000100:00100000:1.0:1788463393.021019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 380 00000100:00100000:1.0:1788463393.021027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466799232:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463393.021086:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466799232:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 59us (4888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463393.021092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 380 00010000:00010000:0.0:1788463393.411957:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463393.667955:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485771008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463393.668033:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463393.668383:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771008 00000100:00100000:0.0:1788463393.668407:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771008 00000100:00100000:0.0:1788463393.668469:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463393.668478:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485771008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463393.668506:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788463393.668571:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463393.673051:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485771008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4564us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463393.673075:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788463393.673840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485771008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463394.182210:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463394.182240:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463394.182318:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463394.182937:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771136 00000100:00100000:0.0:1788463394.182946:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771136 00000100:00100000:0.0:1788463394.183018:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463394.183029:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463394.183063:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463394.183121:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463394.183128:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463394.183175:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485771136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463394.183437:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463394.437360:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463395.204756:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485771264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463395.204839:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463395.205529:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771264 00000100:00100000:0.0:1788463395.205539:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771264 00000100:00100000:0.0:1788463395.205643:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788463395.205655:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485771264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463395.205690:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463395.205755:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485771264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463395.205761:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1788463395.205806:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788407100 x1875339485771264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463395.205845:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485771264:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788463395.206082:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463395.206517:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463395.206533:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485771392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463395.206599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463395.206758:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771392 00000100:00100000:1.0:1788463395.206765:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771392 00000100:00100000:1.0:1788463395.206816:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788463395.206825:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485771392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463395.206851:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788463395.207209:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463395.207233:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485771520:0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.207265:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485771648:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.207280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463395.207321:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485772032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.207343:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463395.207394:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485771392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.207415:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788463395.207468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771648 00000100:00100000:1.0:1788463395.207473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771648 00000100:00100000:1.0:1788463395.207523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788463395.207530:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463395.207614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485771776:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.215954:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463395.216019:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485772544:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.216083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788463395.216129:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188f9e0000 x1875339485771392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463395.216153:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485771392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463395.216181:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788463395.216188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485771904:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.216218:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463395.216246:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485772416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.216283:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463395.216286:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485772160:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.216341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771520 00000100:00100000:2.0:1788463395.216351:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771520 00000100:00100000:3.0:1788463395.216364:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463395.216405:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485772672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.216560:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463395.216698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771904 00000100:00100000:3.0:1788463395.216705:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771904 00000100:00100000:3.0:1788463395.216742:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772160 00000100:00100000:3.0:1788463395.216745:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772160 00000100:00100000:1.0:1788463395.216986:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772544 00000100:00100000:1.0:1788463395.216994:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772544 00000100:00100000:1.0:1788463395.217042:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772416 00000100:00100000:1.0:1788463395.217046:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772416 00000100:00100000:0.0:1788463395.218901:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463395.218953:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485772288:0@lo:400:kworker.0 00000100:00100000:0.0:1788463395.218997:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463395.219010:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485772800:0@lo:400:kworker.0 00000100:00100000:0.0:1788463395.219042:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463395.219096:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788463395.219110:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485772544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.220819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772672 00000100:00100000:3.0:1788463395.222822:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772672 00000100:00100000:2.0:1788463395.222971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788463395.223119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485771520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.224082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463395.224096:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.226287:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485772416:12345-0@lo:400:kworker.0 Request processed in 2187us (10002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.226303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463395.226416:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485771648:12345-0@lo:400:kworker.0 Request processed in 18885us (19074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.226424:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788463395.226425:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485771520:12345-0@lo:400:kworker.0 Request processed in 3322us (19144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463395.226436:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788463395.226446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772288 00000100:00100000:1.0:1788463395.226454:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772288 00000100:00100000:2.0:1788463395.226477:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772032 00000100:00100000:2.0:1788463395.226481:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772032 00000100:00100000:1.0:1788463395.226488:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772800 00000100:00100000:1.0:1788463395.226491:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772800 00000100:00100000:1.0:1788463395.226508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788463395.226512:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485771776 00000100:00100000:2.0:1788463395.226515:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485771776 00000100:00100000:1.0:1788463395.226521:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463395.226528:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485772032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.226529:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788463395.226534:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485771776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.226973:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485772032:12345-0@lo:400:kworker.0 Request processed in 444us (11025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463395.226975:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485771776:12345-0@lo:400:kworker.0 Request processed in 441us (8082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.226994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463395.227018:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485771904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227067:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485771904:12345-0@lo:400:kworker.0 Request processed in 551us (10847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.227073:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788463395.227089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788463395.227096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227120:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485772160:12345-0@lo:400:kworker.0 Request processed in 25us (10758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.227125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788463395.227134:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788463395.227139:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485772288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485772288:12345-0@lo:400:kworker.0 Request processed in 26us (8168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.227172:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788463395.227186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788463395.227191:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227216:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485772800:12345-0@lo:400:kworker.0 Request processed in 25us (8185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463395.227222:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788463395.227292:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485771776:0@lo:400:kworker.0 00010000:00080000:1.0:1788463395.227310:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1a680 x1875339485772288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463395.227320:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485772288:0@lo:400:kworker.0 00010000:00080000:1.0:1788463395.227346:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787da6680 x1875339485772800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463395.227354:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485772800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.227387:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788463395.227416:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463395.227419:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485771904:0@lo:400:kworker.0 00000100:00080000:1.0:1788463395.227421:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463395.227424:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463395.227430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485772416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.227443:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485771520:0@lo:400:kworker.0 00000100:00100000:2.0:1788463395.227452:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485772032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485771648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463395.227568:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.230195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788463395.230217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485772672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463395.230377:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485772672:12345-0@lo:400:kworker.0 Request processed in 166us (13816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463395.230385:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788463395.231990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485772672:0@lo:400:kworker.0 00000100:00100000:0.0:1788463395.236657:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485772544:12345-0@lo:400:kworker.0 Request processed in 17540us (20561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463395.236672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463395.237042:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485772544:0@lo:400:kworker.0 00010000:00010000:1.0:1788463395.460184:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463395.716768:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485772928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463395.716910:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463395.716986:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485772928 00000100:00100000:2.0:1788463395.717003:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485772928 00000100:00100000:2.0:1788463395.717104:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788463395.717115:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485772928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463395.717167:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463395.717256:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485772928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463395.717264:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788463395.717506:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485772928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463396.228007:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485773056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463396.228092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463396.228219:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773056 00000100:00100000:3.0:1788463396.228227:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773056 00000100:00100000:3.0:1788463396.228279:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463396.228289:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485773056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463396.228328:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463396.228386:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485773056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463396.228394:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788463396.228680:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485773056:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463396.486522:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463397.510952:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463398.134675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463398.134723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463398.134758:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463398.134877:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800256 00000100:00100000:0.0:1788463398.134877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800000 00000100:00100000:1.0:1788463398.134889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800256 00000100:00100000:0.0:1788463398.134889:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800000 00000100:00100000:1.0:1788463398.134956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800128 00000100:00100000:1.0:1788463398.134960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800128 00000100:00100000:1.0:1788463398.134996:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 284 00000100:00100000:0.0:1788463398.135001:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 382 00000100:00100000:1.0:1788463398.135009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466800256:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463398.135015:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466800000:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463398.135089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466800000:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 79us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463398.135096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 382 00000100:00100000:2.0:1788463398.135444:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 285 00000100:00100000:2.0:1788463398.135457:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466800128:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:3.0:1788463398.136332:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463398.136339:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463398.141172:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466800256:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 6154us (6435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463398.141187:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 284 00000100:00100000:2.0:1788463398.146143:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466800128:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 10677us (11369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463398.146159:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 285 00000100:00100000:3.0:1788463398.155101:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463398.155155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463398.155197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463398.155234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800384 00000100:00100000:1.0:1788463398.155252:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800384 00000100:00100000:1.0:1788463398.155354:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:1.0:1788463398.155366:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466800384:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:1.0:1788463398.155400:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39948 00000100:00080000:1.0:1788463398.155422:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9618c1ae5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463398.155473:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788463398.155801:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800512 00000100:00100000:2.0:1788463398.155814:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800512 00000100:00100000:2.0:1788463398.155864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800640 00000100:00100000:2.0:1788463398.155868:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800640 00000100:00100000:2.0:1788463398.155894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 286 00000100:00100000:2.0:1788463398.155902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466800512:12345-192.168.204.53@tcp:400:kworker.0 00000100:00080000:3.0:1788463398.155986:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463398.155991:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463398.155993:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463398.157247:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+2:2399:x1875339466800384:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 1877us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463398.157259:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00010000:00010000:1.0:1788463398.157300:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463398.157315:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 287 00000100:00100000:1.0:1788463398.157327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466800640:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463398.164169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466800512:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 8253us (8998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463398.164186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 286 00000100:00100000:1.0:1788463398.164441:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466800640:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 7116us (9241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463398.164450:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 287 00000040:00080000:0.0:1788463398.340730:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788463398.345294:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463398.531795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463398.788559:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463398.788599:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485773184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463398.788670:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463398.788807:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773184 00000100:00100000:2.0:1788463398.788815:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773184 00000100:00100000:2.0:1788463398.788890:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788463398.788903:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485773184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463398.788931:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463398.788989:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485773184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463398.788996:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788463398.789208:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485773184:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788463398.789335:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463399.307137:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463399.307172:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463399.307253:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463399.311639:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773312 00000100:00100000:3.0:1788463399.311668:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773312 00000100:00100000:3.0:1788463399.311757:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788463399.311767:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485773312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463399.311792:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463399.311882:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485773312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463399.311888:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788463399.312104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485773312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463399.314851:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463399.555784:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463400.323804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485773568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463400.323845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485773440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463400.323892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463400.323924:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773568 00000100:00100000:3.0:1788463400.323944:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773568 00000100:00100000:3.0:1788463400.324110:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788463400.324120:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485773568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463400.324149:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463400.326909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463400.326995:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485773952:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327054:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463400.327089:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773952 00000100:00100000:1.0:1788463400.327097:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773952 00000100:00100000:1.0:1788463400.327151:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788463400.327160:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327211:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485773952:12345-0@lo:400:kworker.0 Request processed in 51us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.327218:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788463400.327243:0:8443:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788463400.327264:0:8443:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788463400.327305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485773952:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327327:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485773696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463400.327379:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463400.327386:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485773824:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463400.327436:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773696 00000100:00100000:1.0:1788463400.327439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773696 00000100:00100000:1.0:1788463400.327463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788463400.327469:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485773696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327500:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485773696:12345-0@lo:400:kworker.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.327506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788463400.327535:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485773696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327664:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773440 00000100:00100000:1.0:1788463400.327668:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773440 00000100:00100000:1.0:1788463400.327752:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463400.327759:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485773440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463400.327776:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463400.327809:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485773440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.327815:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1788463400.327840:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178844df80 x1875339485773440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463400.327855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178844df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485773440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463400.327905:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485773824 00000100:00100000:1.0:1788463400.327909:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485773824 00000100:00100000:1.0:1788463400.327946:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788463400.327953:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485773824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.327988:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485773824:12345-0@lo:400:kworker.0 Request processed in 35us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.327994:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788463400.328017:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485773824:0@lo:400:kworker.0 00000100:00080000:1.0:1788463400.328047:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463400.331811:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485773568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7680us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463400.331827:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1788463400.335719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1ad80 x1875339485773568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463400.335754:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485773568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463400.336039:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485774080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.336108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463400.336235:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463400.336267:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463400.336322:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463400.336344:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463400.336406:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774208 00000100:00100000:3.0:1788463400.336413:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774208 00000100:00100000:3.0:1788463400.336458:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788463400.336466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463400.336512:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485774208:12345-0@lo:400:kworker.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463400.336520:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788463400.342092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485774464:0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.342216:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463400.342402:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463400.342423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774080 00000100:00100000:1.0:1788463400.342431:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774080 00000100:00100000:1.0:1788463400.342485:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774336 00000100:00100000:1.0:1788463400.342489:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774336 00000100:00100000:1.0:1788463400.342517:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788463400.342526:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485774080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.342605:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485774080:12345-0@lo:400:kworker.0 Request processed in 80us (6497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.342613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788463400.342632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788463400.342638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485774336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.342667:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485774336:12345-0@lo:400:kworker.0 Request processed in 29us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.342673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1788463400.342692:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463400.342726:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485774336:0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.347055:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485774080:0@lo:400:kworker.0 00000100:00100000:3.0:1788463400.349627:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485774848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.349770:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.349820:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463400.350000:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485774592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.350032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463400.350061:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463400.350067:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485774976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.350177:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774720 00000100:00100000:1.0:1788463400.350184:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774720 00000100:00100000:1.0:1788463400.350234:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774592 00000100:00100000:1.0:1788463400.350238:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774592 00000100:00100000:1.0:1788463400.350270:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463400.350278:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485774720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.350326:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485774720:12345-0@lo:400:kworker.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.350334:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463400.350349:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463400.350355:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485774592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.350383:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485774592:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.350389:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788463400.350407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463400.350433:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.351165:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774464 00000100:00100000:1.0:1788463400.351172:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774464 00000100:00100000:1.0:1788463400.351212:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788463400.351220:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485774464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.351266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463400.351298:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774976 00000100:00100000:2.0:1788463400.351301:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774976 00000100:00100000:2.0:1788463400.351329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788463400.351336:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485774976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.351372:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485774976:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463400.351377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00080000:2.0:1788463400.351431:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727ea00 x1875339485774976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463400.351443:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485774976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.351473:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485774592:0@lo:400:kworker.0 00000100:00080000:2.0:1788463400.351507:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463400.358063:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463400.359600:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485774848 00000100:00100000:2.0:1788463400.359612:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485774848 00000100:00100000:2.0:1788463400.359695:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788463400.359705:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485774848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463400.359792:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485774848:12345-0@lo:400:kworker.0 Request processed in 88us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463400.359809:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1788463400.359960:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463400.359992:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485774848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463400.364099:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485774464:12345-0@lo:400:kworker.0 Request processed in 12869us (21687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463400.364113:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00080000:0.0:1788463400.364260:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787149500 x1875339485774464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463400.364276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485774464:0@lo:400:kworker.0 00010000:00010000:1.0:1788463400.582260:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463400.835843:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463400.835866:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485775104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463400.835969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463400.836097:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775104 00000100:00100000:3.0:1788463400.836106:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775104 00000100:00100000:3.0:1788463400.836155:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788463400.836165:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485775104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463400.836197:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788463400.836248:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485775104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463400.836254:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788463400.836426:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485775104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463401.348347:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463401.348378:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485775232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463401.348445:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463401.348647:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775232 00000100:00100000:3.0:1788463401.348655:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775232 00000100:00100000:3.0:1788463401.348711:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788463401.348721:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485775232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463401.348757:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463401.348813:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485775232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463401.348820:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463401.350860:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485775232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788463401.605218:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463402.628360:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463403.253884:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463403.253928:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463403.253961:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463403.253993:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463403.254029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463403.254364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801024 00000100:00100000:0.0:1788463403.254375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801024 00000100:00100000:0.0:1788463403.254442:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801280 00000100:00100000:0.0:1788463403.254445:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801280 00000100:00100000:0.0:1788463403.254460:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800896 00000100:00100000:0.0:1788463403.254462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800896 00000100:00100000:0.0:1788463403.254474:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801152 00000100:00100000:0.0:1788463403.254477:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801152 00000100:00100000:0.0:1788463403.254493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 294 00000100:00100000:0.0:1788463403.254515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466801024:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463403.254629:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466801024:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 115us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463403.254638:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 294 00000100:00100000:0.0:1788463403.254659:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 295 00000100:00100000:0.0:1788463403.254682:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466801280:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463403.254708:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466801280:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463403.254714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 295 00000100:00100000:0.0:1788463403.254740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 296 00000100:00100000:0.0:1788463403.254747:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466800896:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463403.254774:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466800896:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463403.254779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 296 00000100:00100000:0.0:1788463403.254790:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 297 00000100:00100000:0.0:1788463403.254795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466801152:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463403.254817:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466801152:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 21us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463403.254823:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 297 00000100:00080000:3.0:1788463403.254969:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463403.254974:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463403.255395:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466800768 00000100:00100000:2.0:1788463403.255401:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466800768 00000100:00100000:2.0:1788463403.255444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 384 00000100:00100000:2.0:1788463403.255452:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466800768:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463403.255489:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891696850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466800768:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 39us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463403.256020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 384 00000001:00100000:0.0:1788463403.403313:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:0.0:1788463403.403326:0:8434:0:(genops.c:885:class_export_put()) final put ffff9618c1ae4000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:1.0:1788463403.403789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ae4000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-OST0000 00000020:00000080:1.0:1788463403.404055:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618c1ae5800 for lustre-OST0000 00010000:00010000:1.0:1788463403.651905:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463403.908010:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485775360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463403.908119:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463403.908604:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775360 00000100:00100000:1.0:1788463403.908616:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775360 00000100:00100000:1.0:1788463403.908705:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463403.908717:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485775360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463403.908758:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788463403.910721:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463403.913336:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485775360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4597us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463403.913366:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788463403.917126:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485775360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463404.422104:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463404.422136:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485775488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463404.422239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463404.422503:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775488 00000100:00100000:3.0:1788463404.422514:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775488 00000100:00100000:3.0:1788463404.422650:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788463404.422917:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485775488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463404.422949:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463404.423028:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485775488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463404.423105:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485775488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463404.423180:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463404.432523:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1788463404.676635:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463405.444204:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485775744:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444303:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444379:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485776256:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444406:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444424:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485776768:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444444:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444476:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788463405.444482:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485775872:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444511:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444529:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485776384:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444550:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444611:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444636:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463405.444689:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775744 00000100:00100000:3.0:1788463405.444699:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775744 00000100:00100000:3.0:1788463405.444748:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776256 00000100:00100000:3.0:1788463405.444750:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776256 00000100:00100000:3.0:1788463405.444771:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776768 00000100:00100000:3.0:1788463405.444774:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776768 00000100:00100000:3.0:1788463405.444787:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776384 00000100:00100000:3.0:1788463405.444789:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776384 00000100:00100000:3.0:1788463405.444815:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776896 00000100:00100000:3.0:1788463405.444845:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776896 00000100:00100000:3.0:1788463405.444868:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788463405.444878:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485775744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.444940:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485775744:12345-0@lo:400:kworker.0 Request processed in 62us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.444948:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788463405.444969:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788463405.444976:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485776256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445005:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485776256:12345-0@lo:400:kworker.0 Request processed in 29us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.445011:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788463405.445021:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788463405.445028:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485776768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445054:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485776768:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.445060:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788463405.445070:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788463405.445076:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485776384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445101:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485776384:12345-0@lo:400:kworker.0 Request processed in 26us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.445108:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788463405.445119:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788463405.445125:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485776896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445146:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485776896:12345-0@lo:400:kworker.0 Request processed in 22us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.445161:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00080000:3.0:1788463405.445213:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e19500 x1875339485776384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463405.445228:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485776384:0@lo:400:kworker.0 00010000:00080000:3.0:1788463405.445240:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e18700 x1875339485776896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463405.445249:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485776896:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445261:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485775744:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445278:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485776256:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.445296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485776768:0@lo:400:kworker.0 00000100:00100000:0.0:1788463405.446961:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775872 00000100:00100000:0.0:1788463405.446983:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775872 00000100:00100000:0.0:1788463405.447102:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788463405.447121:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485775872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463405.447275:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485775872:12345-0@lo:400:kworker.0 Request processed in 159us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463405.447287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788463405.447983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485775616:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448052:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448106:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485776128:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448135:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485776640:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448182:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448200:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485777152:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448219:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448242:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788463405.448250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485776000:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448288:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448309:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485776512:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448334:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485777024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448369:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.448403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485775616 00000100:00100000:1.0:1788463405.448410:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485775616 00000100:00100000:1.0:1788463405.448458:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788463405.448466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485775616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.448512:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891697c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485775616:12345-0@lo:400:kworker.0 Request processed in 46us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463405.448519:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788463405.448554:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776128 00000100:00100000:1.0:1788463405.448557:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776128 00000100:00100000:1.0:1788463405.448617:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788463405.448624:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485776128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788463405.448788:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463405.448795:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463405.448819:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776640 00000100:00100000:2.0:1788463405.448824:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776640 00000100:00100000:2.0:1788463405.448863:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777152 00000100:00100000:2.0:1788463405.448876:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777152 00000100:00100000:2.0:1788463405.448901:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776512 00000100:00100000:2.0:1788463405.448904:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776512 00000100:00100000:2.0:1788463405.448916:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777024 00000100:00100000:2.0:1788463405.448918:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777024 00000100:00100000:2.0:1788463405.448933:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463405.448939:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.448981:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485776640:12345-0@lo:400:kworker.0 Request processed in 43us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.448987:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463405.448999:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463405.449005:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485777152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.449033:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485777152:12345-0@lo:400:kworker.0 Request processed in 28us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.449039:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463405.449048:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463405.449054:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485776512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.449078:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485776512:12345-0@lo:400:kworker.0 Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.449084:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463405.449092:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463405.449097:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485777024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.449120:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485777024:12345-0@lo:400:kworker.0 Request processed in 24us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.449126:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463405.449177:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463405.449187:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463405.449226:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463405.449259:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777280 00000100:00100000:2.0:1788463405.449263:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777280 00000100:00100000:2.0:1788463405.449291:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788463405.449298:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485777280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463405.449326:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463405.449362:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485777280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.449369:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788463405.449383:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463405.449386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788463405.449416:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fba8a80 x1875339485777280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463405.449436:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463405.449524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485776512:0@lo:400:kworker.0 00010000:00080000:2.0:1788463405.449533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e1a300 x1875339485777024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463405.449542:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485777024:0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.449552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485775616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.449564:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485776640:0@lo:400:kworker.0 00010000:00080000:2.0:1788463405.449572:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e19f80 x1875339485777152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463405.449610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485777152:0@lo:400:kworker.0 00000100:00100000:1.0:1788463405.450113:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485776128:12345-0@lo:400:kworker.0 Request processed in 1485us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463405.450123:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788463405.450467:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485776128:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.450712:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485776000 00000100:00100000:3.0:1788463405.450720:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485776000 00000100:00100000:3.0:1788463405.450778:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788463405.450788:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485776000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.450884:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485776000:12345-0@lo:400:kworker.0 Request processed in 98us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463405.450890:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788463405.450929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485775872:0@lo:400:kworker.0 00000100:00100000:2.0:1788463405.451330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485776000:0@lo:400:kworker.0 00000100:00100000:3.0:1788463405.451442:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485777408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463405.451509:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463405.452131:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777408 00000100:00100000:2.0:1788463405.452140:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777408 00000100:00100000:2.0:1788463405.452201:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788463405.452210:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485777408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463405.452236:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463405.452304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485777408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463405.452311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1788463405.452703:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e19180 x1875339485777408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463405.452750:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485777408:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788463405.700048:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463405.956194:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485777536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463405.956320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463405.956728:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777536 00000100:00100000:1.0:1788463405.956740:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777536 00000100:00100000:1.0:1788463405.957567:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788463405.957612:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485777536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463405.957673:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463405.964192:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485777536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6567us (7851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463405.964251:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788463405.969747:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485777536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463406.468328:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463406.468362:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485777664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463406.468479:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463406.469075:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777664 00000100:00100000:0.0:1788463406.469087:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777664 00000100:00100000:0.0:1788463406.469157:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788463406.469170:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485777664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463406.469224:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463406.469313:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485777664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463406.469322:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788463406.469632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485777664:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463406.724927:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463407.756255:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463408.365319:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463408.365363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463408.365383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463408.365402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463408.365427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463408.365452:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801664 00000100:00100000:3.0:1788463408.365461:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801664 00000100:00100000:3.0:1788463408.365516:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801920 00000100:00100000:3.0:1788463408.365519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801920 00000100:00100000:3.0:1788463408.365533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801536 00000100:00100000:3.0:1788463408.365536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801536 00000100:00100000:3.0:1788463408.365546:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801792 00000100:00100000:3.0:1788463408.365548:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801792 00000100:00100000:3.0:1788463408.365563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 304 00000100:00100000:3.0:1788463408.365592:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466801664:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463408.365668:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466801664:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.365675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 304 00000100:00100000:3.0:1788463408.365693:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 305 00000100:00100000:3.0:1788463408.365700:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466801920:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463408.365724:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466801920:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.365731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 305 00000100:00100000:3.0:1788463408.365742:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 306 00000100:00100000:3.0:1788463408.365758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466801536:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463408.365798:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466801536:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.365804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 306 00000100:00100000:3.0:1788463408.365817:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 307 00000100:00100000:3.0:1788463408.365823:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466801792:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463408.365846:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466801792:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.365852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 307 00000100:00100000:3.0:1788463408.366007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466801408 00000100:00100000:3.0:1788463408.366012:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466801408 00000100:00100000:3.0:1788463408.366039:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 386 00000100:00100000:3.0:1788463408.366046:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466801408:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463408.366073:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891695c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466801408:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.366079:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 386 00000100:00080000:3.0:1788463408.366133:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463408.366137:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788463408.582924:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788463408.585059:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463408.772544:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463409.027862:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485777792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463409.027943:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463409.028041:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777792 00000100:00100000:1.0:1788463409.028049:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777792 00000100:00100000:1.0:1788463409.028114:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788463409.028125:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485777792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463409.028157:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463409.036491:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485777792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8356us (8537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463409.036509:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1788463409.036554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463409.037266:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485777792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463409.541656:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463409.541692:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485777920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463409.541805:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463409.541930:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485777920 00000100:00100000:0.0:1788463409.541940:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485777920 00000100:00100000:0.0:1788463409.542027:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788463409.542038:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485777920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463409.542078:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463409.542131:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485777920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463409.542138:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788463409.542167:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463409.546415:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485777920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463409.797353:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463410.563882:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485778048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463410.563968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463410.564219:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778048 00000100:00100000:2.0:1788463410.564230:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778048 00000100:00100000:2.0:1788463410.564299:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788463410.564312:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485778048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463410.564342:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463410.564393:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485778048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.564399:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:1.0:1788463410.565682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fba9880 x1875339485778048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463410.565705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485778048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788463410.565837:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463410.566049:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485778432:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566101:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566134:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485778944:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566159:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566191:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485779456:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566213:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566231:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788463410.566237:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485778304:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566256:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566272:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485778816:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566288:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566302:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485779328:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566319:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463410.566350:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778432 00000100:00100000:1.0:1788463410.566356:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778432 00000100:00100000:1.0:1788463410.566398:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788463410.566407:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485778432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566452:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485778432:12345-0@lo:400:kworker.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566460:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788463410.566480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778944 00000100:00100000:1.0:1788463410.566483:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778944 00000100:00100000:1.0:1788463410.566510:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779456 00000100:00100000:1.0:1788463410.566513:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779456 00000100:00100000:1.0:1788463410.566525:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778304 00000100:00100000:1.0:1788463410.566528:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778304 00000100:00100000:1.0:1788463410.566538:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778816 00000100:00100000:1.0:1788463410.566541:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778816 00000100:00100000:1.0:1788463410.566553:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779328 00000100:00100000:1.0:1788463410.566556:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779328 00000100:00100000:1.0:1788463410.566568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788463410.566600:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485778944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566643:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485778944:12345-0@lo:400:kworker.0 Request processed in 69us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788463410.566662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788463410.566667:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485779456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566708:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485779456:12345-0@lo:400:kworker.0 Request processed in 41us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566714:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788463410.566726:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788463410.566744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485778304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566770:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485778304:12345-0@lo:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788463410.566788:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788463410.566793:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485778816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566819:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485778816:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788463410.566838:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788463410.566844:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485779328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566866:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485779328:12345-0@lo:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463410.566872:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:1.0:1788463410.566901:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463410.566905:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463410.566932:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485778304:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566942:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485778816:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566951:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485779328:0@lo:400:kworker.0 00000100:00100000:1.0:1788463410.566960:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485778432:0@lo:400:kworker.0 00010000:00080000:1.0:1788463410.566970:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc21180 x1875339485778944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463410.566979:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485778944:0@lo:400:kworker.0 00010000:00080000:1.0:1788463410.566989:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc20700 x1875339485779456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463410.566998:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485779456:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485778560:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567207:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567242:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779072:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567263:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567277:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567293:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788463410.567313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485778176:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567337:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485778688:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567375:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567393:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485779200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567413:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.567437:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778688 00000100:00100000:0.0:1788463410.567442:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778688 00000100:00100000:0.0:1788463410.567467:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463410.567474:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485778688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463410.567510:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485778688:12345-0@lo:400:kworker.0 Request processed in 35us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463410.567516:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463410.567540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485778688:0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.567612:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779072 00000100:00100000:2.0:1788463410.567617:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779072 00000100:00100000:2.0:1788463410.567652:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779584 00000100:00100000:2.0:1788463410.567662:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779584 00000100:00100000:2.0:1788463410.567684:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779200 00000100:00100000:2.0:1788463410.567687:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779200 00000100:00100000:2.0:1788463410.567698:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788463410.567704:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.567753:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779072:12345-0@lo:400:kworker.0 Request processed in 48us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.567760:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788463410.567772:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463410.567779:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.567805:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779584:12345-0@lo:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.567811:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463410.567821:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463410.567827:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.567849:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485779200:12345-0@lo:400:kworker.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.567855:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463410.567874:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778176 00000100:00100000:2.0:1788463410.567878:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778176 00000100:00100000:2.0:1788463410.567902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788463410.567909:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485778176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.567935:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485778176:12345-0@lo:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.567942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00080000:2.0:1788463410.567971:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463410.567980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485778560 00000100:00100000:2.0:1788463410.567989:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485778560 00000100:00100000:2.0:1788463410.568015:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788463410.568021:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485778560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.568051:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485778560:12345-0@lo:400:kworker.0 Request processed in 31us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463410.568057:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788463410.568083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485778176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.568093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485779200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.568101:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485778560:0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.568109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779072:0@lo:400:kworker.0 00010000:00080000:2.0:1788463410.568119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787ea8700 x1875339485779584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463410.568128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779584:0@lo:400:kworker.0 00000100:00100000:2.0:1788463410.568959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463410.568973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463410.569016:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463410.569267:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779712 00000100:00100000:0.0:1788463410.569274:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779712 00000100:00100000:0.0:1788463410.569317:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788463410.569326:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463410.569361:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463410.569418:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485779712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463410.569424:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:3.0:1788463410.569503:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e1b480 x1875339485779712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463410.569519:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485779712:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788463410.822332:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463411.079023:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463411.079048:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485779840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463411.079124:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463411.079214:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779840 00000100:00100000:1.0:1788463411.079224:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779840 00000100:00100000:1.0:1788463411.080028:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788463411.080044:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485779840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463411.080085:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788463411.090193:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485779840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10142us (11058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463411.090209:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788463411.099143:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485779840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463411.588798:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485779968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463411.588879:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463411.588987:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485779968 00000100:00100000:1.0:1788463411.588996:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485779968 00000100:00100000:1.0:1788463411.589061:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788463411.589070:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485779968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463411.589107:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463411.597528:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485779968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8450us (8641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463411.597544:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788463411.598811:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485779968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463411.843996:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463412.867879:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463413.488657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463413.488770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463413.489978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463413.490011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463413.494282:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802176 00000100:00100000:1.0:1788463413.494296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802176 00000100:00100000:1.0:1788463413.494391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802432 00000100:00100000:1.0:1788463413.494395:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802432 00000100:00100000:1.0:1788463413.494426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 314 00000100:00100000:1.0:1788463413.494436:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466802176:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463413.494753:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466802176:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 317us (6109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463413.494762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 314 00000100:00100000:1.0:1788463413.494781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 315 00000100:00100000:1.0:1788463413.494788:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466802432:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463413.494814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466802432:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (6044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463413.494820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 315 00000100:00080000:1.0:1788463413.494843:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463413.495693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463413.495725:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802048 00000100:00100000:3.0:1788463413.495732:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802048 00000100:00100000:3.0:1788463413.495771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 388 00000100:00100000:3.0:1788463413.495779:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466802048:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463413.495823:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466802048:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 44us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463413.495831:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 388 00000100:00100000:3.0:1788463413.495865:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802304 00000100:00100000:3.0:1788463413.495868:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802304 00000100:00100000:3.0:1788463413.495898:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802560 00000100:00100000:3.0:1788463413.495900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802560 00000100:00100000:3.0:1788463413.495921:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 316 00000100:00100000:3.0:1788463413.495928:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466802304:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463413.495955:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466802304:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (5943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463413.495961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 316 00000100:00080000:1.0:1788463413.497314:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463413.498726:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 317 00000100:00100000:2.0:1788463413.498749:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466802560:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463413.498823:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466802560:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 86us (3135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463413.498831:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 317 00010000:00010000:2.0:1788463413.893268:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463414.073043:0:14075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:23:32 (1788463412) 00000100:00100000:1.0:1788463414.153135:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463414.153162:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485780096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463414.153242:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463414.153452:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780096 00000100:00100000:3.0:1788463414.154120:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780096 00000100:00100000:3.0:1788463414.154192:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788463414.154203:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485780096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463414.154243:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463414.155638:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485780096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1428us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463414.155652:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788463414.156431:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463414.157607:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485780096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463414.659865:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463414.659889:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485780224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463414.660105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463414.660481:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780224 00000100:00100000:2.0:1788463414.660490:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780224 00000100:00100000:2.0:1788463414.662001:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463414.662014:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485780224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463414.662041:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463414.662116:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485780224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463414.662124:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788463414.662537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485780224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463414.665385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463414.919552:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463415.684835:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463415.684867:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485780352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463415.684977:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463415.685233:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780352 00000100:00100000:0.0:1788463415.685245:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780352 00000100:00100000:0.0:1788463415.685327:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788463415.685352:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485780352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463415.685391:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463415.685462:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485780352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463415.685469:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:0.0:1788463415.685518:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e19880 x1875339485780352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463415.685542:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485780352:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788463415.688848:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463415.689246:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485780736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.689343:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463415.689362:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485780864:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.689408:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485781248:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.689437:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463415.689504:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780736 00000100:00100000:2.0:1788463415.689515:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780736 00000100:00100000:0.0:1788463415.689534:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485780480:0@lo:400:kworker.0 00000100:00100000:2.0:1788463415.689604:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788463415.689616:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485780736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.692564:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463415.692668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485781760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.692723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463415.692754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788463415.692763:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485780608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.692787:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463415.692827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485781120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.692851:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463415.692870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485781632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.692891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463415.692927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780864 00000100:00100000:1.0:1788463415.692934:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780864 00000100:00100000:1.0:1788463415.692977:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781248 00000100:00100000:1.0:1788463415.692980:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781248 00000100:00100000:1.0:1788463415.693000:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781760 00000100:00100000:1.0:1788463415.693003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781760 00000100:00100000:1.0:1788463415.693015:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780608 00000100:00100000:1.0:1788463415.693018:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780608 00000100:00100000:1.0:1788463415.693028:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781120 00000100:00100000:1.0:1788463415.693030:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781120 00000100:00100000:1.0:1788463415.693042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781632 00000100:00100000:1.0:1788463415.693044:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781632 00000100:00100000:1.0:1788463415.693060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788463415.693068:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485780864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693140:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485780864:12345-0@lo:400:kworker.0 Request processed in 71us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788463415.693164:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788463415.693170:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485781248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693205:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485781248:12345-0@lo:400:kworker.0 Request processed in 35us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693210:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788463415.693221:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788463415.693226:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485781760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485781760:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788463415.693268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788463415.693274:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485780608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693298:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485780608:12345-0@lo:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788463415.693312:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788463415.693317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485781120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693340:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485781120:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693346:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788463415.693356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788463415.693361:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485781632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485781632:12345-0@lo:400:kworker.0 Request processed in 36us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.693403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788463415.693425:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463415.693429:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463415.693462:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485780608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485781120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.693479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485781632:0@lo:400:kworker.0 00010000:00080000:1.0:1788463415.693492:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b24a80 x1875339485781248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463415.693501:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485781248:0@lo:400:kworker.0 00010000:00080000:1.0:1788463415.693509:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b24700 x1875339485781760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463415.693517:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485781760:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.693886:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485780864:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.693903:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485781376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.694465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463415.694528:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485781888:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.694565:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463415.694675:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781376 00000100:00100000:3.0:1788463415.694999:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781376 00000100:00100000:3.0:1788463415.695058:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781888 00000100:00100000:3.0:1788463415.695061:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781888 00000100:00100000:3.0:1788463415.695183:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463415.695195:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485781376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.695259:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485781376:12345-0@lo:400:kworker.0 Request processed in 68us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463415.695268:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463415.695286:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788463415.695292:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485781888:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788463415.695564:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463415.698909:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485781376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.702735:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463415.702865:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485780992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.703270:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463415.703330:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780992 00000100:00100000:0.0:1788463415.703347:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780992 00000100:00100000:0.0:1788463415.703411:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788463415.703422:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485780992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.703491:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485780992:12345-0@lo:400:kworker.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463415.703500:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788463415.703554:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485780992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.703565:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485781504:0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.703625:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463415.703664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485781504 00000100:00100000:0.0:1788463415.703668:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485781504 00000100:00100000:0.0:1788463415.703710:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463415.703718:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485781504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.703752:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485781504:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463415.703759:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463415.704229:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485781504:0@lo:400:kworker.0 00000100:00100000:0.0:1788463415.704241:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485782016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463415.704287:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463415.704481:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485782016 00000100:00100000:0.0:1788463415.704487:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485782016 00000100:00100000:0.0:1788463415.704523:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788463415.704531:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c004bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485782016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463415.704571:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463415.704668:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c004bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485782016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463415.704676:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788463415.706953:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485780480 00000100:00100000:1.0:1788463415.706974:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485780480 00000100:00100000:1.0:1788463415.707086:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788463415.707285:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485780480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463415.707423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485780480:12345-0@lo:400:kworker.0 Request processed in 327us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463415.707431:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788463415.707607:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485780480:0@lo:400:kworker.0 00010000:00080000:1.0:1788463415.707642:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884a2d80 x1875339485782016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463415.707666:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485782016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463415.712062:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485780736:12345-0@lo:400:kworker.0 Request processed in 22434us (22705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463415.712078:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788463415.712735:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485780736:0@lo:400:kworker.0 00000100:00100000:3.0:1788463415.718300:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485781888:12345-0@lo:400:kworker.0 Request processed in 22991us (23718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463415.718320:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1788463415.719045:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b26680 x1875339485781888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463415.720248:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485781888:0@lo:400:kworker.0 00010000:00010000:3.0:1788463415.942173:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463416.195989:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463416.196020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463416.196123:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463416.198339:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485782144 00000100:00100000:2.0:1788463416.198359:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485782144 00000100:00100000:2.0:1788463416.198437:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788463416.198450:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485782144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463416.198502:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788463416.198653:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485782144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 206us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463416.198662:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463416.198870:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485782144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463416.449779:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463416.450070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802688 00000100:00100000:2.0:1788463416.450114:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802688 00000100:00100000:2.0:1788463416.450216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:2.0:1788463416.450235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:11101:x1875339466802688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463416.450266:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788463416.453812:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463416.458425:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39a28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766ce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.458522:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.458539:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.458555:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463416.459704:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463416.459708:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463416.459753:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.459785:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39a28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ce expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.459808:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ce expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.459818:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655200) 00010000:00010000:2.0:1788463416.459820:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463416.459824:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:2.0:1788463416.459922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+6:11101:x1875339466802688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 9695us (10159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463416.459931:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:1.0:1788463416.469156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463416.469249:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802816 00000100:00100000:2.0:1788463416.469260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802816 00000100:00100000:2.0:1788463416.469332:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:2.0:1788463416.469344:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+6:11102:x1875339466802816:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463416.469367:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463416.469395:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39a36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766d5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469466:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469480:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469492:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469554:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469563:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469569:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469675:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469696:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469704:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463416.469744:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463416.469748:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463416.469767:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469777:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469784:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469790:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469795:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463416.469799:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469807:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469818:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655200) 00010000:00010000:2.0:1788463416.469821:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463416.469826:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469842:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469858:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469864:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469870:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469874:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463416.469877:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469882:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469890:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff961894655900) 00010000:00010000:2.0:1788463416.469892:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463416.469895:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469900:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39a44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469931:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766d5 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469947:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766d5 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463416.469973:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961894655700) 00010000:00010000:2.0:1788463416.469976:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463416.469978:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21200, rc 0) 00000100:00100000:2.0:1788463416.470044:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+7:11102:x1875339466802816:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 702us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463416.470051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:3.0:1788463416.485844:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463416.488799:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466802944 00000100:00100000:1.0:1788463416.488816:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466802944 00000100:00100000:1.0:1788463416.488896:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:1.0:1788463416.488907:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68497686-852f-43ff-8be6-586d5980ece4+7:11102:x1875339466802944:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788463416.489017:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:68497686-852f-43ff-8be6-586d5980ece4+7:11102:x1875339466802944:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 Request processed in 111us (3187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463416.489025:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463416.513257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463416.513472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803200 00000100:00100000:1.0:1788463416.513483:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803200 00000100:00100000:1.0:1788463416.513550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:1.0:1788463416.513563:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+7:11102:x1875339466803200:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463416.513634:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463416.513679:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a39a52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766dc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513755:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513770:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513782:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513826:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513834:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513841:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513967:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a39a67 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513976:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a39a67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.513995:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a39a67 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463416.514005:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788463416.514093:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514111:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514118:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514124:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463416.514128:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514136:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514147:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961894655700) 00010000:00010000:1.0:1788463416.514150:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463416.514154:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514160:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39a59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514175:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514181:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514187:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514191:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463416.514202:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514209:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514216:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961787b98c00) 00010000:00010000:1.0:1788463416.514218:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463416.514221:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514227:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39a60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514719:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a39a52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766dc expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514736:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a39a67 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766dc expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463416.514743:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:1.0:1788463416.514746:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463416.514749:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c800, rc 0) 00000100:00100000:1.0:1788463416.514824:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+9:11102:x1875339466803200:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 1263us (1581us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788463416.514833:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:3.0:1788463416.536927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463416.544788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803328 00000100:00100000:2.0:1788463416.544806:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803328 00000100:00100000:2.0:1788463416.544901:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:2.0:1788463416.544912:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+9:11102:x1875339466803328:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788463416.545499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+9:11102:x1875339466803328:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 569us (8570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463416.545514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:3.0:1788463416.554733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463416.555112:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803456 00000100:00100000:1.0:1788463416.555126:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803456 00000100:00100000:1.0:1788463416.555243:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463416.555257:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:11102:x1875339466803456:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788463416.555506:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788463416.570255:0:12162:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 14910us 00000100:00100000:3.0:1788463416.633014:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:11102:x1875339466803456:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 77745us (78281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463416.633035:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463416.709431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485782272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463416.709539:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463416.709729:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485782272 00000100:00100000:2.0:1788463416.709741:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485782272 00000100:00100000:2.0:1788463416.709816:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788463416.709828:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485782272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463416.709873:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463416.724596:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485782272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14735us (15021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463416.724629:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788463416.729394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485782272:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788463416.775502:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788463416.782778:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788463416.965624:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.990610:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463418.605281:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463418.605354:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463418.605381:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463418.605418:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463418.605444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463418.605482:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803840 00000100:00100000:3.0:1788463418.605504:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803840 00000100:00100000:3.0:1788463418.605617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804096 00000100:00100000:3.0:1788463418.605621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804096 00000100:00100000:3.0:1788463418.605640:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803712 00000100:00100000:3.0:1788463418.605643:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803712 00000100:00100000:3.0:1788463418.605663:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803968 00000100:00100000:3.0:1788463418.605666:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803968 00000100:00100000:3.0:1788463418.605687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 324 00000100:00100000:3.0:1788463418.605699:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466803840:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463418.605934:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466803584 00000100:00100000:0.0:1788463418.605939:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466803584 00000100:00100000:0.0:1788463418.605975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 390 00000100:00100000:0.0:1788463418.605982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466803584:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463418.606049:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466803584:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 67us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463418.606062:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 390 00000100:00100000:3.0:1788463418.607104:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466803840:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1394us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463418.607124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 324 00000100:00100000:3.0:1788463418.608598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 325 00000100:00100000:3.0:1788463418.608630:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466804096:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463418.609812:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 326 00000100:00100000:1.0:1788463418.609835:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+9:2403:x1875339466803712:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463418.610186:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+9:2403:x1875339466803712:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 358us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463418.610196:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 326 00000100:00100000:1.0:1788463418.610229:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 327 00000100:00100000:1.0:1788463418.610315:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466803968:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463418.610352:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466803968:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 114us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463418.610359:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 327 00000100:00080000:1.0:1788463418.610386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463418.610393:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463418.610932:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466804096:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 2313us (5546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463418.610943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 325 00000040:00080000:2.0:1788463418.821461:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788463418.824330:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463419.011785:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463419.271132:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463419.271163:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485782400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463419.271254:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463419.271325:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485782400 00000100:00100000:0.0:1788463419.271334:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485782400 00000100:00100000:0.0:1788463419.271401:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788463419.271411:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485782400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463419.271444:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463419.271490:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485782400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463419.271497:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788463419.271548:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485782400:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788463419.272168:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463419.295615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463419.295730:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804224 00000100:00100000:0.0:1788463419.295752:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804224 00000100:00100000:0.0:1788463419.295846:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:0.0:1788463419.295866:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+9:11145:x1875339466804224:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463419.295889:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463419.295912:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39a75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766e3 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.295978:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.295993:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296005:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296021:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296029:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296036:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296080:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296088:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296095:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296108:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463419.296112:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296121:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296133:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655200) 00010000:00010000:0.0:1788463419.296136:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463419.296141:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296147:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39a7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296161:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296168:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296173:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296178:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463419.296181:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296188:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296343:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961787b9ae00) 00010000:00010000:0.0:1788463419.296346:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463419.296350:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296357:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39a83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296391:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39a75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766e3 expref: 10 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296402:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655200) 00010000:00010000:0.0:1788463419.296404:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463419.296408:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39a75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766e3 expref: 10 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.296417:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5c00, rc 0) 00000100:00100000:0.0:1788463419.296485:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+9:11145:x1875339466804224:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 622us (879us total) trans 0 rc 301/301 00000100:00100000:0.0:1788463419.296493:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:0.0:1788463419.308400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.310533:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804480 00000100:00100000:3.0:1788463419.310550:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804480 00000100:00100000:3.0:1788463419.310671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:3.0:1788463419.310685:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+9:11145:x1875339466804480:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:3.0:1788463419.310744:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463419.310770:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39a2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ce expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.310806:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655200) 00010000:00010000:3.0:1788463419.311112:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463419.311183:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.311197:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.311290:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.311306:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.311314:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.311322:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314219:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314233:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463419.314251:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a60244d4 reply state 00000000b2efe7f5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314276:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314284:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463419.314287:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463419.314291:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788463419.314297:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788463419.314306:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314312:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314318:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314323:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfa00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463419.314327:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314335:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314344:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463419.314346:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463419.314349:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314355:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a8a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463419.314383:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a60244d4 reply state 00000000b2efe7f5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314391:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.314397:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961885469d00) 00010000:00010000:3.0:1788463419.314399:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463419.314401:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788463419.314542:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+10:11145:x1875339466804480:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 3857us (6146us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788463419.314551:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:2.0:1788463419.456618:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.456742:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804608 00000100:00100000:3.0:1788463419.456752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804608 00000100:00100000:3.0:1788463419.457917:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:3.0:1788463419.457933:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+10:11153:x1875339466804608:12345-192.168.204.53@tcp:101:lctl.0 00010000:00010000:3.0:1788463419.457958:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463419.457982:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766ea expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458296:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458310:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458321:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463419.458380:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788463419.458384:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463419.458434:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458459:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ea expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458477:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ea expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.458486:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463419.458489:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463419.458493:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdea00, rc 0) 00000100:00100000:3.0:1788463419.458592:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+11:11153:x1875339466804608:12345-192.168.204.53@tcp:101:lctl.0 Request processed in 646us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463419.458602:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:2.0:1788463419.583515:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.588490:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804736 00000100:00100000:3.0:1788463419.588512:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804736 00000100:00100000:3.0:1788463419.588685:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:3.0:1788463419.588701:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+11:11159:x1875339466804736:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463419.588733:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463419.588765:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39aad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766f1 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588869:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588918:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588936:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588952:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588960:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.588967:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589074:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589084:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589092:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463419.589138:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788463419.589143:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463419.589199:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589214:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589233:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589240:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589247:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463419.589253:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589261:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589276:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463419.589280:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463419.589286:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589293:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589311:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589318:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589324:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589329:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463419.589338:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589344:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589352:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961885469d00) 00010000:00010000:3.0:1788463419.589355:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463419.589358:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589365:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39abb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589396:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39aad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f1 expref: 13 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589411:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f1 expref: 12 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.589418:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463419.589421:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788463419.589423:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfe00, rc 0) 00000100:00100000:3.0:1788463419.589524:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+12:11159:x1875339466804736:12345-192.168.204.53@tcp:101:bash.0 Request processed in 825us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463419.589533:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463419.597569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.598777:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466804992 00000100:00100000:3.0:1788463419.598794:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466804992 00000100:00100000:3.0:1788463419.598911:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:3.0:1788463419.598926:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+12:11159:x1875339466804992:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463419.598976:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463419.599008:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39ac9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766f8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.599172:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.599194:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.599209:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.606828:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.606854:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.606867:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463419.607246:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788463419.607386:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607396:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607458:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607464:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607470:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607476:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463419.607481:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607488:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607500:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463419.607503:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463419.607507:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.607513:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39ad0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463419.616916:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034066189 reply state 000000001a9b1fd7 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.617158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.617170:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961885469b00) 00010000:00010000:3.0:1788463419.617190:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463419.617196:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463419.617381:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39ac9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463419.617439:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463419.617448:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:2.0:1788463419.617451:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463419.617455:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdee00, rc 0) 00000100:00100000:2.0:1788463419.617714:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+15:11159:x1875339466804992:12345-192.168.204.53@tcp:101:bash.0 Request processed in 18789us (20169us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788463419.617725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:2.0:1788463419.647765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463419.647901:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466805120 00000100:00100000:1.0:1788463419.647916:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466805120 00000100:00100000:1.0:1788463419.647983:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:1.0:1788463419.647993:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466805120:12345-192.168.204.53@tcp:8:bash.0 00010000:00080000:1.0:1788463419.648052:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1788463419.648112:0:8441:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a39aec 00002000:00100000:1.0:1788463419.648128:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68497686-852f-43ff-8be6-586d5980ece4/ffff9618c1ae4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463419.648171:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463419.648273:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788463419.648313:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787f94800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463419.648413:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466805120:12345-192.168.204.53@tcp:8:bash.0 Request processed in 420us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463419.648422:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:3.0:1788463419.666796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463419.667686:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466805248 00000100:00100000:0.0:1788463419.667702:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466805248 00000100:00100000:0.0:1788463419.667794:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:0.0:1788463419.667806:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466805248:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463419.667828:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463419.667896:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4766ff expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463419.667937:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463419.667965:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788463419.667970:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463419.667983:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463419.668010:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463419.668612:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463419.668737:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5200, rc 0) 00000100:00100000:0.0:1788463419.668836:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:0:x1875339466805248:12345-192.168.204.53@tcp:101:bash.0 Request processed in 1030us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463419.670321:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:3.0:1788463419.689827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463419.691698:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466805376 00000100:00100000:1.0:1788463419.691720:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466805376 00000100:00100000:1.0:1788463419.691818:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463419.691831:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:11159:x1875339466805376:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463419.691867:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463419.691914:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476706 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463419.691968:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463419.691979:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463419.691985:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463419.691992:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463419.692056:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463419.692072:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 8 pid: 9857 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463419.692111:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875339485782528:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463419.692265:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618884fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463419.703542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463419.704129:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8441:1875339485782528:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463419.704180:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463419.704209:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:3.0:1788463419.704392:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466805504 00000100:00100000:3.0:1788463419.704402:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466805504 00010000:00010000:3.0:1788463419.704460:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 9 pid: 9857 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463419.704513:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:3.0:1788463419.704525:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466805504:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463419.704543:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463419.704625:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 9 pid: 9857 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.704642:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 9 pid: 9857 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.704677:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000575a8600/0x841acb7f42a39af3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ff expref: 9 pid: 9857 timeout: 559 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.704697:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463419.704702:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463419.704712:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.704751:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463419.704797:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463419.704815:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875339485782656:192.168.204.53@tcp:105: 00000100:00100000:1.0:1788463419.704941:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+8:11159:x1875339466805376:12345-192.168.204.53@tcp:101:bash.0 Request processed in 13103us (15121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463419.704950:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463419.706532:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff961881377f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463419.720011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.720252:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466805760 00000100:00100000:3.0:1788463419.720265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466805760 00000100:00100000:3.0:1788463419.720345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:3.0:1788463419.720369:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+15:11159:x1875339466805760:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:3.0:1788463419.720808:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+16:11159:x1875339466805760:12345-192.168.204.53@tcp:35:bash.0 Request processed in 451us (810us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788463419.720817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:1.0:1788463419.725205:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6508:1875339485782656:192.168.204.53@tcp:105: 00010000:00010000:1.0:1788463419.725250:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463419.725960:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466805504:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 21432us (22431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463419.725974:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:1.0:1788463419.782433:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463419.782470:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463419.782626:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463419.783538:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485782784 00000100:00100000:0.0:1788463419.783551:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485782784 00000100:00100000:0.0:1788463419.783696:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788463419.783707:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485782784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463419.783742:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463419.783820:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485782784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463419.783828:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788463419.784293:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485782784:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463419.784391:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463419.868620:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.868888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466806016 00000100:00100000:3.0:1788463419.868902:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466806016 00000100:00100000:3.0:1788463419.868991:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463419.869003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+16:11169:x1875339466806016:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463419.870098:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463419.870427:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39b01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47670d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463419.870621:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788463419.870795:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39b01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47670d expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463419.870816:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463419.870820:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463419.870826:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39b01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47670d expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463419.870845:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463419.871200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+17:11169:x1875339466806016:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2197us (2629us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788463419.871209:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:2.0:1788463419.877440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463419.877749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466806272 00000100:00100000:3.0:1788463419.877763:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466806272 00000100:00100000:3.0:1788463419.877843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463419.877856:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+17:11169:x1875339466806272:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463419.879392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+18:11169:x1875339466806272:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 1528us (2842us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788463419.879404:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:0.0:1788463420.007371:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.007652:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466806400 00000100:00100000:3.0:1788463420.007668:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466806400 00000100:00100000:3.0:1788463420.007776:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:3.0:1788463420.007792:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+18:11175:x1875339466806400:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463420.007826:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788463420.007997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463420.008171:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476714 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008273:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008290:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008305:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463420.008365:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788463420.008370:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463420.008397:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008428:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476714 expref: 20 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008454:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476714 expref: 19 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.008483:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463420.008487:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463420.008492:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:3.0:1788463420.008642:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+19:11175:x1875339466806400:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 853us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463420.008653:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:0.0:1788463420.015218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.015368:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466806656 00000100:00100000:2.0:1788463420.015384:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466806656 00000100:00100000:2.0:1788463420.015474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:2.0:1788463420.015489:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+19:11175:x1875339466806656:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463420.015520:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463420.015563:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39b1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47671b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.016151:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.016173:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.016190:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463420.016206:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788463420.016390:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39b1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47671b expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.016414:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47671b expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.016424:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:3.0:1788463420.016428:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463420.016432:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde000, rc 0) 00000100:00100000:3.0:1788463420.016525:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+21:11175:x1875339466806656:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1039us (1318us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788463420.016557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:0.0:1788463420.020948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.021249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466806912 00000100:00100000:2.0:1788463420.021263:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466806912 00000100:00100000:2.0:1788463420.021350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:2.0:1788463420.021365:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+21:11175:x1875339466806912:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463420.021398:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463420.021427:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39b32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476722 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.021644:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.021664:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.021678:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463420.021709:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788463420.022195:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39b32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476722 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.022225:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476722 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.022236:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:2.0:1788463420.022239:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463420.022244:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20800, rc 0) 00000100:00100000:2.0:1788463420.022323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+23:11175:x1875339466806912:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 962us (1391us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788463420.022333:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:0.0:1788463420.026949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463420.027188:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807040 00000100:00100000:1.0:1788463420.027203:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807040 00000100:00100000:1.0:1788463420.027308:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463420.027324:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+23:2403:x1875339466807040:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463420.027347:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463420.027383:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39b24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47671b expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.027410:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:1.0:1788463420.027416:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463420.027503:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+22:2403:x1875339466807040:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 182us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.027512:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00010000:00010000:2.0:1788463420.035832:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463420.037808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.038032:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807168 00000100:00100000:3.0:1788463420.038046:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807168 00000100:00100000:3.0:1788463420.038129:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:3.0:1788463420.038143:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466807168:12345-192.168.204.53@tcp:1:lfs.0 00010000:00010000:3.0:1788463420.038207:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.038234:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.038244:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463420.038249:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463420.038254:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.038303:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.038320:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 7 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463420.038338:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485782912:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463420.038482:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463420.044690:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485782912:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463420.044761:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463420.046034:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463420.046161:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807296 00000100:00100000:1.0:1788463420.046175:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807296 00002000:00100000:1.0:1788463420.046248:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9618c1b27100 x1875339466807296/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:556/0 lens 504/0 e 0 to 0 dl 1788463431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463420.046261:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b27100 with x1875339466807296 ext(0->12) 00010000:00010000:1.0:1788463420.046272:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.046291:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 8 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463420.046299:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9618c1b27100 00000100:00100000:1.0:1788463420.046350:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463420.046360:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466807296:12345-192.168.204.53@tcp:4:lfs.0 00000001:00100000:3.0:1788463420.056662:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000100:00100000:1.0:1788463420.058450:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466807296:12345-192.168.204.53@tcp:4:lfs.0 Request processed in 12074us (12411us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788463420.058492:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00002000:00100000:1.0:1788463420.058507:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9618c1b27100 x1875339466807296/t4294967300(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:556/0 lens 504/448 e 0 to 0 dl 1788463431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463420.058519:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b27100 with x1875339466807296 ext(0->12) 00010000:00010000:1.0:1788463420.058532:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.058566:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463420.058609:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9618c1b27100 00000100:00100000:2.0:1788463420.062305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463420.062604:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807424 00000100:00100000:1.0:1788463420.062616:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807424 00010000:00010000:1.0:1788463420.062663:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.062708:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:1.0:1788463420.062719:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+9:2403:x1875339466807424:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463420.062738:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788463420.062756:0:6552:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788463420.062759:0:6552:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788463420 00002000:00010000:1.0:1788463420.062761:0:6552:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788463420 00002000:00010000:1.0:1788463420.062763:0:6552:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788463420 00002000:00010000:1.0:1788463420.062765:0:6552:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788463420.062772:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.062800:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.062825:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a774913/0x841acb7f42a39afa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476706 expref: 9 pid: 8441 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.062843:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463420.063097:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463420.063105:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.063115:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.063154:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463420.063352:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063362:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063383:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063391:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063397:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063404:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463420.063409:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063417:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063443:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.063451:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db020c5/0x841acb7f42a39b47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.063535:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2403:x1875339466807424:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 816us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.063544:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:3.0:1788463420.071656:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466807168:12345-192.168.204.53@tcp:1:lfs.0 Request processed in 33503us (33848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463420.071672:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:0.0:1788463420.079127:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.079196:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807680 00000100:00100000:3.0:1788463420.079210:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807680 00000100:00100000:3.0:1788463420.079286:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463420.079296:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+22:11175:x1875339466807680:12345-192.168.204.53@tcp:35:lfs.0 00000004:00010000:3.0:1788463420.079364:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476722 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463420.081821:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788463420.082412:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788463420.084127:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788463420.084183:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.084204:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.084214:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.084755:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.084772:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 26 pid: 6522 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463420.084786:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485783040:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463420.085059:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b210c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463420.102502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.102736:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485783040:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463420.102769:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.106820:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807808 00000100:00100000:1.0:1788463420.106845:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807808 00010000:00010000:1.0:1788463420.107064:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 27 pid: 6522 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.107121:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:1.0:1788463420.107134:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+27:2400:x1875339466807808:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463420.107168:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463420.107176:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 27 pid: 6522 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107191:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 27 pid: 6522 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107215:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39ade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f8 expref: 27 pid: 6522 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107235:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:1.0:1788463420.107240:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107394:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107403:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.107477:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463420.107543:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+26:2400:x1875339466807808:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 410us (5052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.107562:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00010000:00010000:3.0:1788463420.121666:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.121683:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463420.121796:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788463420.121921:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788463420.122041:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485783168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463420.122107:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463420.122178:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463420.122902:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783168 00000100:00100000:2.0:1788463420.122912:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783168 00000100:00100000:2.0:1788463420.122980:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788463420.122993:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485783168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788463420.123104:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485783168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.123112:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788463420.123165:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463420.123798:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485783168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788463420.123989:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788463420.124060:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485783296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463420.124121:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463420.125434:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463420.128106:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783296 00000100:00100000:1.0:1788463420.128122:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783296 00000100:00100000:0.0:1788463420.131900:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788463420.131918:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485783296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788463420.132156:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1875339485783296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 244us (8033us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788463420.132165:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788463420.132247:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485783296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788463420.132321:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788463420.132367:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132377:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132384:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132390:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463420.132395:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132403:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132417:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:3.0:1788463420.132420:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788463420.132425:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.132431:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b4e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463420.132538:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788463420.132672:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788463420.132683:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459584107634ns, next at 460584105314ns, rc = 0 00000001:00080000:3.0:1788463420.132689:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788463420.132725:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469000) 00010000:00010000:3.0:1788463420.132728:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788463420.132734:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b39 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476722 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463420.132826:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+29:11175:x1875339466807680:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 53532us (53710us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788463420.132834:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000020:00080000:3.0:1788463420.132838:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788463420.138798:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.138965:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466807936 00000100:00100000:3.0:1788463420.138975:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466807936 00000100:00100000:3.0:1788463420.139034:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:3.0:1788463420.139044:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+29:11175:x1875339466807936:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463420.139066:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463420.139091:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39b55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476729 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.139147:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39b55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476729 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.139160:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39b55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476729 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.139176:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463420.139179:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463420.139182:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:3.0:1788463420.141687:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+30:11175:x1875339466807936:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2632us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463420.141717:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:3.0:1788463420.146728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.149787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466808192 00000100:00100000:2.0:1788463420.149804:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466808192 00000100:00100000:2.0:1788463420.150186:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:2.0:1788463420.150198:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+30:11175:x1875339466808192:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:2.0:1788463420.150464:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+31:11175:x1875339466808192:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 268us (3745us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788463420.150472:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463420.303535:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.303672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466808448 00000100:00100000:3.0:1788463420.303684:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466808448 00000100:00100000:3.0:1788463420.303753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:3.0:1788463420.303764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+31:11185:x1875339466808448:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463420.303787:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463420.303807:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476730 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463420.303934:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788463420.304044:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476730 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.304059:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463420.304062:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463420.304067:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476730 expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.304082:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf200, rc 0) 00000100:00100000:3.0:1788463420.304153:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+32:11185:x1875339466808448:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 391us (628us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788463420.304161:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:0.0:1788463420.307099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.307382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466808576 00000100:00100000:2.0:1788463420.307395:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466808576 00000100:00100000:2.0:1788463420.307471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463420.307482:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+32:11185:x1875339466808576:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:2.0:1788463420.307609:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307629:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307642:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307656:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307664:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307671:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307753:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307781:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307788:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463420.307853:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307867:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307873:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307880:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307959:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463420.307966:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307974:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.307987:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463420.307990:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463420.307995:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308002:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39b6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308133:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308140:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308146:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308151:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463420.308155:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308161:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308372:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961885469b00) 00010000:00010000:2.0:1788463420.308376:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463420.308381:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39b71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308400:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308406:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308412:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308424:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463420.308428:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308434:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308443:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463420.308445:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463420.308448:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.308454:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39b78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463420.308559:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+32:11185:x1875339466808576:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 1077us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.308569:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463420.320335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.322307:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466808832 00000100:00100000:3.0:1788463420.322322:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466808832 00000100:00100000:3.0:1788463420.322397:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:3.0:1788463420.322409:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+32:11185:x1875339466808832:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463420.322729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+33:11185:x1875339466808832:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 321us (2404us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788463420.322739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:0.0:1788463420.384861:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.397939:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466809088 00000100:00100000:3.0:1788463420.397956:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466809088 00000100:00100000:3.0:1788463420.398053:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463420.398065:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+33:11188:x1875339466809088:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463420.398091:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463420.398115:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476737 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398194:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398210:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398221:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398234:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398242:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398602:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398720:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398742:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.398750:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463420.398762:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788463420.399177:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399187:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399194:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399200:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463420.399204:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399212:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399225:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463420.399229:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463420.399234:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399240:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39b86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399637:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399652:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399657:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399663:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463420.399666:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399673:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399682:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961885469b00) 00010000:00010000:3.0:1788463420.399684:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463420.399688:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399694:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39b8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399741:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39b7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 36 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399754:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 35 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463420.399761:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463420.399763:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463420.399772:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdee00, rc 0) 00000100:00100000:3.0:1788463420.402040:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+35:11188:x1875339466809088:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 3964us (17175us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788463420.402054:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:0.0:1788463420.410988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463420.411164:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466809216 00000100:00100000:1.0:1788463420.411174:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466809216 00000100:00100000:1.0:1788463420.411255:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:1.0:1788463420.411266:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:11188:x1875339466809216:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463420.411340:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411357:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411369:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411406:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411414:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411420:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411426:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0de00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463420.411430:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411437:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411448:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463420.411450:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463420.411455:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.411472:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39ba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.411561:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:11188:x1875339466809216:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 297us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.411569:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:2.0:1788463420.418206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.418454:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466809472 00000100:00100000:3.0:1788463420.418465:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466809472 00000100:00100000:3.0:1788463420.418526:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:3.0:1788463420.418537:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+35:11188:x1875339466809472:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463420.418829:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+36:11188:x1875339466809472:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 293us (633us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788463420.419794:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463420.804069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485783424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463420.804144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463420.804375:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783424 00000100:00100000:0.0:1788463420.804384:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783424 00000100:00100000:0.0:1788463420.804445:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788463420.804455:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485783424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463420.804479:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463420.804545:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485783424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463420.804553:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788463420.804806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485783424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463420.804825:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463420.804832:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485783552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463420.804859:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463420.805011:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783552 00000100:00100000:3.0:1788463420.805016:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783552 00000100:00100000:3.0:1788463420.805069:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463420.805076:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485783552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463420.805090:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463420.805126:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485783552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463420.805132:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463420.805162:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485783552:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788463420.805542:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463420.805756:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485783936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463420.805800:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463420.805891:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485783680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.805925:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463420.805950:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463420.805956:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485783808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.805981:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463420.806008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783680 00000100:00100000:1.0:1788463420.806013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783680 00000100:00100000:1.0:1788463420.806047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788463420.806054:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485783680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.806089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485783680:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.806096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788463420.806147:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485783680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.806179:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783936 00000100:00100000:1.0:1788463420.806183:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783936 00000100:00100000:1.0:1788463420.806219:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788463420.806226:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485783936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.806306:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485783808 00000100:00100000:2.0:1788463420.806310:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485783808 00000100:00100000:2.0:1788463420.806343:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788463420.806350:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.806389:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485783808:12345-0@lo:400:kworker.0 Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.806395:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788463420.806421:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485783808:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.807956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485784064:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.808009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463420.808065:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784064 00000100:00100000:2.0:1788463420.808072:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784064 00000100:00100000:2.0:1788463420.808112:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788463420.808119:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485784064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.808158:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485784064:12345-0@lo:400:kworker.0 Request processed in 40us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.808165:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788463420.808205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485784064:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.818082:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485783936:12345-0@lo:400:kworker.0 Request processed in 11847us (12271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.818097:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788463420.827047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485783936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.827691:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463420.831403:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485784320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.831487:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463420.831522:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485784192:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.831563:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463420.834819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784320 00000100:00100000:0.0:1788463420.834845:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784320 00000100:00100000:0.0:1788463420.835054:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788463420.835079:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463420.835168:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485784320:12345-0@lo:400:kworker.0 Request processed in 91us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463420.835175:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788463420.835226:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485784320:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.835329:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784192 00000100:00100000:2.0:1788463420.835335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784192 00000100:00100000:2.0:1788463420.835373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463420.835381:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485784192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.835427:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485784192:12345-0@lo:400:kworker.0 Request processed in 47us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.835433:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463420.835457:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485784192:0@lo:400:kworker.0 00000100:00080000:1.0:1788463420.835730:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463420.836072:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463420.836130:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463420.836144:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788463420.836188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463420.839034:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784576 00000100:00100000:1.0:1788463420.839050:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784576 00000100:00100000:1.0:1788463420.839135:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788463420.839144:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485784576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.839234:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485784576:12345-0@lo:400:kworker.0 Request processed in 91us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.839241:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788463420.839366:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485784576:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.843018:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485784448:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.843106:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463420.843981:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485784704:0@lo:400:kworker.0 00000100:00100000:3.0:1788463420.844026:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463420.844055:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463420.844060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485784832:0@lo:400:kworker.0 00000100:00100000:3.0:1788463420.844083:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463420.844136:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463420.844145:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485784960:0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.844188:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784704 00000100:00100000:2.0:1788463420.844195:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784704 00000100:00100000:2.0:1788463420.844258:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788463420.844267:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485784704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.844317:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485784704:12345-0@lo:400:kworker.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.844323:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788463420.845325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.845406:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485784704:0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.845467:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784448 00000100:00100000:1.0:1788463420.845473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784448 00000100:00100000:1.0:1788463420.845547:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788463420.845558:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485784448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.845632:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485784448:12345-0@lo:400:kworker.0 Request processed in 77us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.845649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788463420.845671:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784832 00000100:00100000:1.0:1788463420.845675:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784832 00000100:00100000:1.0:1788463420.845700:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788463420.845707:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485784832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463420.845747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485784832:12345-0@lo:400:kworker.0 Request processed in 41us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463420.845753:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:3.0:1788463420.846125:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463420.846137:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463420.846183:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485784832:0@lo:400:kworker.0 00000100:00100000:0.0:1788463420.846370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466809728 00000100:00100000:0.0:1788463420.846377:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466809728 00000100:00100000:0.0:1788463420.846411:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:0.0:1788463420.846420:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+36:11219:x1875339466809728:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:0.0:1788463420.846435:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463420.846456:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39ba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47673e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463420.846601:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463420.846615:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463420.846629:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463420.846640:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788463420.849072:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39ba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47673e expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463420.849104:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47673e expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463420.849113:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:0.0:1788463420.849116:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463420.849120:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5c00, rc 0) 00000100:00100000:3.0:1788463420.854737:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463420.855173:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485784960 00000100:00100000:2.0:1788463420.855183:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485784960 00000100:00100000:2.0:1788463420.855260:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788463420.855271:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485784960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463420.855348:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485784960:12345-0@lo:400:kworker.0 Request processed in 79us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.855355:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00080000:2.0:1788463420.855418:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788442d80 x1875339485784960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463420.855434:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485784960:0@lo:400:kworker.0 00010000:00080000:2.0:1788463420.855454:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788443100 x1875339485784448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463420.855463:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485784448:0@lo:400:kworker.0 00000100:00080000:3.0:1788463420.856353:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463420.857845:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+38:11219:x1875339466809728:12345-192.168.204.53@tcp:101:cat.0 Request processed in 11404us (12501us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788463420.857859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:0.0:1788463420.866914:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463420.867065:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466809856 00000100:00100000:2.0:1788463420.867075:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466809856 00000100:00100000:2.0:1788463420.867149:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:2.0:1788463420.867175:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+38:2403:x1875339466809856:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463420.867191:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463420.867218:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47673e expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463420.867238:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463420.867243:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463420.867303:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+37:2403:x1875339466809856:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 132us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463420.867310:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:0.0:1788463420.874527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463420.874773:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466810112 00000100:00100000:3.0:1788463420.874783:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466810112 00000100:00100000:3.0:1788463420.874840:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:3.0:1788463420.874852:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+37:11219:x1875339466810112:12345-192.168.204.53@tcp:35:cat.0 00000100:00100000:3.0:1788463420.875117:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+38:11219:x1875339466810112:12345-192.168.204.53@tcp:35:cat.0 Request processed in 266us (599us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788463420.875125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:0.0:1788463420.997085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463420.997207:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466810368 00000100:00100000:1.0:1788463420.997218:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466810368 00000100:00100000:1.0:1788463420.997286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:1.0:1788463420.997296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+38:11225:x1875339466810368:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:1.0:1788463420.997326:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463420.997334:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463420.997362:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a39b16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476714 expref: 38 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997384:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:1.0:1788463420.997389:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463420.997405:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39bbe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476745 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997524:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997552:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 38 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997648:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997686:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 38 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463420.997700:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 38 pid: 12162 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463420.997717:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485785088:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463420.997845:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463421.005980:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485785088:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463421.006017:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463421.013293:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463421.017008:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466810496 00000100:00100000:1.0:1788463421.017025:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466810496 00010000:00010000:1.0:1788463421.017082:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 39 pid: 12162 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463421.017208:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:1.0:1788463421.017219:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+39:2400:x1875339466810496:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463421.017236:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463421.017243:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 39 pid: 12162 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017277:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 39 pid: 12162 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017299:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a39b94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476737 expref: 39 pid: 12162 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017320:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463421.017326:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017335:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017343:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.017385:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463421.017457:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+38:2400:x1875339466810496:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 240us (4175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463421.017465:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00010000:00010000:2.0:1788463421.017546:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.017555:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463421.017604:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788463421.017770:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39bbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.017786:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.017795:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.017798:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463421.017800:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:2.0:1788463421.019434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+38:11225:x1875339466810368:12345-192.168.204.53@tcp:101:dd.0 Request processed in 22129us (22350us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788463421.019461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:0.0:1788463421.030407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463421.032602:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466810624 00000100:00100000:2.0:1788463421.032622:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466810624 00000100:00100000:2.0:1788463421.032684:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:2.0:1788463421.032694:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+38:11225:x1875339466810624:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:2.0:1788463421.032715:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463421.032734:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39bd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47674c expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.032769:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.032784:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.032796:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.033177:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39bd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 40 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.033197:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 39 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.033206:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.033208:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463421.033213:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:2.0:1788463421.033273:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+39:11225:x1875339466810624:12345-192.168.204.53@tcp:101:dd.0 Request processed in 581us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463421.033289:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:0.0:1788463421.036675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463421.036969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466810880 00000100:00100000:2.0:1788463421.036981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466810880 00000100:00100000:2.0:1788463421.037103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:2.0:1788463421.037114:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+39:11225:x1875339466810880:12345-192.168.204.53@tcp:36:dd.0 00010000:00010000:2.0:1788463421.037357:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.037375:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.037386:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463421.037432:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788463421.037458:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a495bddd reply state 00000000a1a3f5c6 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.037471:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.037478:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.037481:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463421.037485:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463421.038059:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+42:11225:x1875339466810880:12345-192.168.204.53@tcp:36:dd.0 Request processed in 502us (949us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788463421.038067:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00000020:00080000:2.0:1788463421.038073:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788463421.060271:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463421.316292:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485785216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463421.316393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463421.316715:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485785216 00000100:00100000:1.0:1788463421.316726:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485785216 00000100:00100000:1.0:1788463421.316782:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788463421.316792:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485785216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463421.316835:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788463421.316982:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485785216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463421.317000:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788463421.317644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485785216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463421.420761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463421.424893:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466811008 00000100:00100000:2.0:1788463421.424909:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466811008 00000100:00100000:2.0:1788463421.425000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:2.0:1788463421.425013:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+42:11239:x1875339466811008:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:2.0:1788463421.425038:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463421.425061:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39be8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476753 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425128:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425143:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425154:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425165:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425173:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425179:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425250:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425261:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425286:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425320:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.425334:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 43 pid: 6522 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463421.425349:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485785344:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463421.425466:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463421.428420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463421.428749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466811264 00000100:00100000:3.0:1788463421.428762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466811264 00000100:00100000:3.0:1788463421.428854:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:3.0:1788463421.428866:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+44:6171:x1875339466811264:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788463421.429311:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+45:6171:x1875339466811264:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 443us (901us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788463421.429321:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:2.0:1788463421.430199:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485785344:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463421.430253:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463421.432432:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463421.432706:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466811392 00000100:00100000:1.0:1788463421.432727:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466811392 00010000:00010000:1.0:1788463421.432783:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 45 pid: 6522 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463421.432833:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:1.0:1788463421.432845:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+45:2400:x1875339466811392:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463421.432863:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463421.432871:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 45 pid: 6522 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.432887:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 45 pid: 6522 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.432915:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39bc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476745 expref: 45 pid: 6522 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.432936:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463421.432943:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.432954:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.432962:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463421.433035:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463421.433109:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+44:2400:x1875339466811392:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 265us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463421.433117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00010000:00010000:3.0:1788463421.434252:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434267:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463421.434341:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788463421.434361:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463421.434421:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434440:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434453:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434461:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434470:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434476:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463421.434481:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434502:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434517:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463421.434531:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463421.434536:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434544:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434562:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434974:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434981:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434986:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463421.434990:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.434997:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.435008:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961885469b00) 00010000:00010000:3.0:1788463421.435012:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463421.435015:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.435021:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.435075:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39be8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476753 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.435090:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476753 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.435098:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463421.435100:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463421.435111:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20800, rc 0) 00000100:00100000:3.0:1788463421.435192:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+43:11239:x1875339466811008:12345-192.168.204.53@tcp:101:stat.0 Request processed in 10181us (14440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463421.435202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:0.0:1788463421.533650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463421.533863:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466811648 00000100:00100000:2.0:1788463421.533877:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466811648 00000100:00100000:2.0:1788463421.533963:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:2.0:1788463421.533977:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+43:11245:x1875339466811648:12345-192.168.204.53@tcp:36:truncate.0 00010000:00010000:2.0:1788463421.534061:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463421.534097:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39bfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476753 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.534141:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.534158:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463421.534420:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.534440:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.534452:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463421.534506:0:10067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788463421.534542:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0ee9463 reply state 00000000c329ccb0 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.534557:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.534564:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.534567:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463421.534570:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463421.534786:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+45:11245:x1875339466811648:12345-192.168.204.53@tcp:36:truncate.0 Request processed in 812us (1151us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788463421.534795:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000020:00080000:2.0:1788463421.534801:0:10067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1788463421.553271:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:1.0:1788463421.553320:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788463421.553349:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961786b21600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788463421.553356:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618901bf900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961786b219c0 00000020:00080000:1.0:1788463421.553360:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618901bf000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961889b77400 00000020:00080000:1.0:1788463421.553446:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788463421.553743:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1788463421.553965:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.553991:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554000:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554007:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdec00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463421.554021:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554031:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554054:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff961885469d00) 00010000:00010000:0.0:1788463421.554058:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463421.554064:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554071:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39a91 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554099:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554105:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554111:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554117:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463421.554120:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554125:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554133:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463421.554135:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463421.554146:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554153:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39a98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554172:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554179:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554184:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554189:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463421.554192:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554198:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554206:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961885469b00) 00010000:00010000:0.0:1788463421.554209:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463421.554212:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554218:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39ad7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554235:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554251:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554257:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554262:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463421.554265:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554271:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554280:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:0.0:1788463421.554282:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463421.554286:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554291:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39be1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554306:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554311:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554318:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554323:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463421.554332:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554339:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554348:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:0.0:1788463421.554351:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463421.554353:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463421.554359:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463421.557143:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485785472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788463421.557259:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463421.557418:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485785472 00000100:00100000:2.0:1788463421.557428:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485785472 00000100:00100000:2.0:1788463421.557505:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463421.557526:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485785472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788463421.557566:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788463421.557639:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a99c93c, atime: 0x6a99c93c, ctime: 0x6a99c93c, blocks: 0x8 00010000:00010000:2.0:1788463421.557650:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.557705:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1788463421.557711:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463421.557720:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.557742:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.557753:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.557761:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.557784:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463421.558000:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485785472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 484us (739us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788463421.558009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788463421.558036:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463421.558044:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.558053:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463421.558058:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.558080:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.558100:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.558108:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a39c0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.558135:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463421.558137:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463421.558138:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788463421.558773:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96188d1c1f80/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788463421.558784:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485785472:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788463421.811788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463421.812699:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466811776 00000100:00100000:2.0:1788463421.812716:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466811776 00000100:00100000:2.0:1788463421.812813:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463421.812828:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+11:11259:x1875339466811776:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:2.0:1788463421.812863:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463421.812894:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47675a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.813025:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.813044:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817449:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817539:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817554:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817564:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817800:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817883:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.817892:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463421.817961:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788463421.817967:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463421.818388:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818406:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818415:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818422:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818447:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818454:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463421.818459:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818467:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818482:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463421.818485:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463421.818489:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818496:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818525:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818532:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818538:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818543:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463421.818546:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818563:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818786:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961894655100) 00010000:00010000:2.0:1788463421.818791:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463421.818795:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818802:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818940:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 13 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818959:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463421.818967:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463421.818969:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463421.818981:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463421.819085:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+12:11259:x1875339466811776:12345-192.168.204.53@tcp:101:stat.0 Request processed in 6259us (7315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463421.819096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463421.827996:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463421.828033:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463421.828164:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463421.828209:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485785600 00000100:00100000:3.0:1788463421.828220:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485785600 00000100:00100000:3.0:1788463421.828289:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788463421.828303:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485785600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463421.831157:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463421.831320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485785600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3014us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463421.831333:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788463421.831497:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485785600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463421.946058:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463421.946172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466812032 00000100:00100000:3.0:1788463421.946186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466812032 00000100:00100000:3.0:1788463421.946275:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:3.0:1788463421.946288:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+12:11269:x1875339466812032:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463421.946318:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463421.946363:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476761 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463421.946508:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788463421.947690:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476761 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.947714:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463421.947717:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463421.947724:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476761 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463421.947768:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf200, rc 0) 00000100:00100000:3.0:1788463421.947880:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+13:11269:x1875339466812032:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1593us (1837us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788463421.947890:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:1.0:1788463421.953246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463421.953346:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466812288 00000100:00100000:3.0:1788463421.953360:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466812288 00000100:00100000:3.0:1788463421.953437:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:3.0:1788463421.953449:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+13:11269:x1875339466812288:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463421.953889:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+14:11269:x1875339466812288:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 440us (656us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788463421.953897:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:1.0:1788463422.079332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.079624:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466812544 00000100:00100000:2.0:1788463422.079639:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466812544 00000100:00100000:2.0:1788463422.079739:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:2.0:1788463422.079756:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+14:11275:x1875339466812544:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463422.079790:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.079828:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c3c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476768 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.079978:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.079999:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.080010:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.080054:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.080070:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 15 pid: 6524 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463422.080086:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485785728:192.168.204.53@tcp:104: 00000100:00080000:3.0:1788463422.080198:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463422.080779:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6000 going to sleep for 11 seconds 00010000:00010000:2.0:1788463422.083904:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463422.093848:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485785728:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463422.093901:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463422.097710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.099844:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466812672 00000100:00100000:3.0:1788463422.099868:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466812672 00010000:00010000:3.0:1788463422.099938:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 16 pid: 6524 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463422.100011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463422.100023:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+16:2400:x1875339466812672:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463422.100046:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463422.100054:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 16 pid: 6524 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100071:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 16 pid: 6524 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100126:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47675a expref: 16 pid: 6524 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100149:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463422.100156:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100168:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100178:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.100221:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463422.100311:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+15:2400:x1875339466812672:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 290us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463422.100319:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00010000:00010000:2.0:1788463422.101454:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.101469:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.101497:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788463422.101746:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 16 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.101768:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 15 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.101778:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.101781:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463422.101784:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:2.0:1788463422.101872:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+15:11275:x1875339466812544:12345-192.168.204.53@tcp:101:bash.0 Request processed in 22123us (22556us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788463422.101883:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463422.115542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.115647:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466812928 00000100:00100000:2.0:1788463422.115661:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466812928 00000100:00100000:2.0:1788463422.115733:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:2.0:1788463422.115745:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+15:11275:x1875339466812928:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:2.0:1788463422.116091:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.116115:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.116145:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463422.116205:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788463422.116233:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abc8d4b8 reply state 000000004dd79ea4 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.116249:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.116257:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.116260:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463422.116265:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463422.116461:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+18:11275:x1875339466812928:12345-192.168.204.53@tcp:36:bash.0 Request processed in 716us (929us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788463422.116470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000020:00080000:2.0:1788463422.116477:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788463422.123159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.123439:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466813056 00000100:00100000:2.0:1788463422.123454:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466813056 00000100:00100000:2.0:1788463422.124083:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:2.0:1788463422.124100:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+18:11275:x1875339466813056:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463422.124137:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.124170:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47676f expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.124301:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.124336:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 19 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.124366:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.124412:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 19 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.124428:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 19 pid: 10067 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463422.124445:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485785856:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463422.124608:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463422.131559:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485785856:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463422.131647:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463422.132033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463422.132487:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466813184 00000100:00100000:1.0:1788463422.132498:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466813184 00010000:00010000:1.0:1788463422.132599:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 20 pid: 10067 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463422.132653:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:1.0:1788463422.132665:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+20:2401:x1875339466813184:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463422.132684:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463422.132692:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 20 pid: 10067 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.132722:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 20 pid: 10067 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.132772:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476768 expref: 20 pid: 10067 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.132796:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463422.133246:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.133259:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.133270:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.133315:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463422.134482:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+19:2401:x1875339466813184:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 1805us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463422.134498:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00010000:00010000:2.0:1788463422.134957:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.134973:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.135056:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788463422.135062:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463422.135092:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.135138:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47676f expref: 19 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.135185:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47676f expref: 18 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.135195:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.135198:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463422.135202:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463422.135271:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+18:11275:x1875339466813056:12345-192.168.204.53@tcp:101:bash.0 Request processed in 11176us (12129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.135279:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:0.0:1788463422.143055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.143214:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466813440 00000100:00100000:2.0:1788463422.143232:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466813440 00000100:00100000:2.0:1788463422.143313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:2.0:1788463422.143342:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+18:11275:x1875339466813440:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:2.0:1788463422.143694:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+19:11275:x1875339466813440:12345-192.168.204.53@tcp:35:bash.0 Request processed in 354us (660us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788463422.143703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:3.0:1788463422.246053:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.246498:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466813696 00000100:00100000:2.0:1788463422.246522:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466813696 00000100:00100000:2.0:1788463422.246673:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:2.0:1788463422.246687:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+19:11285:x1875339466813696:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463422.246724:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.247029:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476776 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.247174:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788463422.247453:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476776 expref: 21 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.247471:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463422.247475:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463422.247482:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476776 expref: 21 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.247500:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20600, rc 0) 00000100:00100000:2.0:1788463422.247781:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+20:11285:x1875339466813696:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1096us (1754us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788463422.247791:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:0.0:1788463422.252950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.253522:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466813824 00000100:00100000:3.0:1788463422.253537:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466813824 00000100:00100000:3.0:1788463422.253758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:3.0:1788463422.253773:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+20:11285:x1875339466813824:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:3.0:1788463422.253900:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.253923:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254082:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254192:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254203:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254211:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254309:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254319:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254327:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463422.254391:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254408:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254416:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254424:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254445:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.254451:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254461:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254477:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463422.254481:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463422.254488:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254497:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39c74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254525:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254532:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254539:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254544:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.254547:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254553:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254607:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9618b7c44900) 00010000:00010000:3.0:1788463422.254610:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463422.254615:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254621:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254638:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254643:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254649:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254654:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.254658:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254663:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254671:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463422.254674:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463422.254677:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.254683:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463422.254870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+20:11285:x1875339466813824:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 1097us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463422.254880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:1.0:1788463422.257300:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.257431:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466814080 00000100:00100000:3.0:1788463422.257444:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466814080 00000100:00100000:3.0:1788463422.257528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:3.0:1788463422.257541:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+20:11285:x1875339466814080:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463422.258006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+21:11285:x1875339466814080:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 466us (718us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788463422.258015:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:0.0:1788463422.289642:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.289805:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466814336 00000100:00100000:2.0:1788463422.289819:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466814336 00000100:00100000:2.0:1788463422.289912:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:2.0:1788463422.289926:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+21:11288:x1875339466814336:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463422.289959:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.290003:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47677d expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290113:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290132:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290146:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290189:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290197:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290205:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290355:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290365:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290373:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.290385:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788463422.290488:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290496:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290514:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290521:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.290527:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290547:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290565:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463422.290568:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463422.290611:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290619:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a39c90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290634:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290641:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290648:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290654:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.290657:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290664:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290672:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961894655100) 00010000:00010000:2.0:1788463422.290674:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463422.290678:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290695:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a39c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290749:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a39c89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47677d expref: 24 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290765:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47677d expref: 23 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.290772:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.290774:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463422.290777:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463422.290874:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+23:11288:x1875339466814336:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 950us (1313us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788463422.290884:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:0.0:1788463422.294624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.295518:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466814464 00000100:00100000:2.0:1788463422.295535:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466814464 00000100:00100000:2.0:1788463422.295664:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:2.0:1788463422.295678:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+23:11288:x1875339466814464:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:2.0:1788463422.295779:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295812:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295827:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295898:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295907:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295915:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295921:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.295926:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295934:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.295949:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.295952:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463422.295957:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.296221:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463422.296345:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+23:11288:x1875339466814464:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 668us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.296354:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:3.0:1788463422.298882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.299175:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466814592 00000100:00100000:2.0:1788463422.299188:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466814592 00000100:00100000:2.0:1788463422.299502:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:2.0:1788463422.299546:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+23:2400:x1875339466814592:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463422.299668:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463422.299706:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a39c9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47677d expref: 23 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.299731:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.299737:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463422.303375:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.303810:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466814848 00000100:00100000:3.0:1788463422.303829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466814848 00000100:00100000:3.0:1788463422.303906:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:3.0:1788463422.303920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+23:11288:x1875339466814848:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463422.304655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+24:11288:x1875339466814848:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 733us (1291us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788463422.304666:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:2.0:1788463422.304835:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+23:2400:x1875339466814592:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 5291us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.304848:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:3.0:1788463422.463844:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.464103:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466815104 00000100:00100000:2.0:1788463422.464118:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466815104 00000100:00100000:2.0:1788463422.464201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:2.0:1788463422.464211:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+23:11306:x1875339466815104:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:2.0:1788463422.464241:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.464266:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476784 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.464417:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39cba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.464436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39cba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.464451:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39cba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.464466:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788463422.464696:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476784 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.464720:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39cba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476784 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.464730:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.464734:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463422.464738:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812c00, rc 0) 00000100:00100000:2.0:1788463422.464829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+25:11306:x1875339466815104:12345-192.168.204.53@tcp:101:cat.0 Request processed in 619us (999us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788463422.464837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:0.0:1788463422.485390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.485472:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466815232 00000100:00100000:2.0:1788463422.485486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466815232 00000100:00100000:2.0:1788463422.485623:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:2.0:1788463422.485636:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+25:11307:x1875339466815232:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463422.485670:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463422.485699:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47678b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.485791:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.485810:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.485825:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.485907:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788463422.485911:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463422.485936:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.485985:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47678b expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.486011:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47678b expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.486021:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463422.486024:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463422.486028:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:2.0:1788463422.486277:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+26:11307:x1875339466815232:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 642us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.486287:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:0.0:1788463422.490407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.490693:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466815616 00000100:00100000:3.0:1788463422.490708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466815616 00000100:00100000:3.0:1788463422.490991:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:3.0:1788463422.491006:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+26:11307:x1875339466815616:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463422.491413:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+27:11307:x1875339466815616:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 409us (1018us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788463422.491439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:3.0:1788463422.494124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463422.495085:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466815744 00000100:00100000:1.0:1788463422.495103:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466815744 00000100:00100000:1.0:1788463422.495237:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:1.0:1788463422.495251:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+27:11307:x1875339466815744:12345-192.168.204.53@tcp:103:lfs.0 00010000:00010000:1.0:1788463422.495283:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788463422.495318:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a39c5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47676f expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.495377:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39cba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476784 expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.495396:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39b55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476729 expref: 25 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.495410:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463422.495415:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463422.495516:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+24:11307:x1875339466815744:12345-192.168.204.53@tcp:103:lfs.0 Request processed in 268us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463422.495525:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463422.497635:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.498032:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466815872 00000100:00100000:2.0:1788463422.498047:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466815872 00000100:00100000:2.0:1788463422.498127:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:2.0:1788463422.498139:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+24:11307:x1875339466815872:12345-192.168.204.53@tcp:58:lfs.0 00010000:00010000:2.0:1788463422.498316:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.498338:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.498353:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463422.498771:0:10067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463422.499352:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788463422.499457:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788463422.499769:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+24:11307:x1875339466815872:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 1626us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.499782:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:0.0:1788463422.520940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.523089:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816000 00000100:00100000:3.0:1788463422.523821:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816000 00000100:00100000:3.0:1788463422.524012:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:3.0:1788463422.524027:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+24:11309:x1875339466816000:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463422.524059:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463422.524089:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39cdd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476792 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524197:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524215:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524230:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524247:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524254:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524259:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524367:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524398:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524406:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463422.524465:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788463422.524470:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463422.524495:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524521:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524530:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524536:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524544:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524549:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.524554:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524562:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524612:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463422.524622:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463422.524629:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524637:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39ce4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524654:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524660:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524665:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524670:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.524673:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524678:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524685:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9618b7c44900) 00010000:00010000:3.0:1788463422.524688:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463422.524691:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524696:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39ceb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524734:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39cdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 26 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524761:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 25 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.524770:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463422.524772:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463422.524774:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde000, rc 0) 00000100:00100000:3.0:1788463422.524874:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+25:11309:x1875339466816000:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 851us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463422.524883:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 77 00000040:00080000:0.0:1788463422.916727:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463422.916743:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463422.916815:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788463422.916827:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463422.917033:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9e0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485785984:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463422.917170:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463422.922845:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9e0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485785984:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463422.933433:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.934808:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816128 00000100:00100000:2.0:1788463422.934826:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816128 00000100:00100000:2.0:1788463422.934925:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:2.0:1788463422.934937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+25:11320:x1875339466816128:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463422.934998:0:6524:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463422.935272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+25:11320:x1875339466816128:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 336us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.935281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:0.0:1788463422.951100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.951205:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816256 00000100:00100000:2.0:1788463422.951219:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816256 00000100:00100000:2.0:1788463422.951294:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:2.0:1788463422.951307:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+25:11320:x1875339466816256:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788463422.951413:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951435:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951454:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951500:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951510:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951517:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951553:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951562:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951569:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463422.951659:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788463422.951665:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463422.951680:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951694:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951700:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951708:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951725:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.951731:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951740:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951755:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463422.951758:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463422.951764:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951770:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39cf9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951790:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951795:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951800:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951805:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.951807:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951813:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951831:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff961894655100) 00010000:00010000:2.0:1788463422.951834:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463422.951838:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951844:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951864:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951870:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951875:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951880:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463422.951883:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951888:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951896:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463422.951898:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463422.951901:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.951907:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463422.952006:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+25:11320:x1875339466816256:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 701us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.952015:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:0.0:1788463422.964856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.964965:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816512 00000100:00100000:3.0:1788463422.964980:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816512 00000100:00100000:3.0:1788463422.965060:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 80 00000100:00100000:3.0:1788463422.965073:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+25:11320:x1875339466816512:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463422.965100:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463422.965125:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39d0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476799 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965277:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965296:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965312:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463422.965334:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788463422.965442:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965451:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965458:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965463:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463422.965469:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965478:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965503:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:3.0:1788463422.965506:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463422.965512:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965519:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965570:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39d0e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476799 expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965652:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:3.0:1788463422.965654:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463422.965659:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39d0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476799 expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463422.965681:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:3.0:1788463422.965745:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466816512:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 675us (906us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788463422.965754:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 80 00000100:00100000:0.0:1788463422.971633:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463422.971986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816640 00000100:00100000:3.0:1788463422.972000:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816640 00000100:00100000:3.0:1788463422.972081:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00100000:3.0:1788463422.972094:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466816640:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463422.972146:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463422.972328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466816640:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 226us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463422.972336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00100000:0.0:1788463422.976864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463422.976984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466816896 00000100:00100000:1.0:1788463422.976998:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466816896 00000100:00100000:1.0:1788463422.977079:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 82 00000100:00100000:1.0:1788463422.977093:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466816896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463422.977121:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463422.977125:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463422.977161:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39ccf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47678b expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.977189:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:1.0:1788463422.977207:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463422.977225:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767a0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463422.978141:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788463422.979656:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.979684:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.979699:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.979803:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a0 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.979828:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a0 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463422.979837:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961884f9d700) 00010000:00010000:1.0:1788463422.979840:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463422.979845:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0dc00, rc 0) 00000100:00100000:1.0:1788463422.979932:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+27:11320:x1875339466816896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 2842us (3085us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788463422.979943:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 82 00000100:00100000:0.0:1788463422.994156:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463422.994276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817152 00000100:00100000:2.0:1788463422.994290:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817152 00000100:00100000:2.0:1788463422.994381:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:2.0:1788463422.994395:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+27:11320:x1875339466817152:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463422.994476:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463422.994521:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a0 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.994545:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961884f9d700) 00010000:00010000:2.0:1788463422.994559:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463422.994656:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.994673:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463422.994683:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007514:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007549:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007563:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007669:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007676:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007684:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007708:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.007713:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007720:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007734:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463423.007737:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463423.007742:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007749:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39d38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007768:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007775:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007781:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007786:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.007789:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007795:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007814:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xad7d5e0d (ffff961787b9a100) 00010000:00010000:0.0:1788463423.007817:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463423.007820:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.007826:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39d3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xad7d5e0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463423.008141:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466817152:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 13546us (13795us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463423.008152:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:0.0:1788463423.015520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.015814:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817280 00000100:00100000:2.0:1788463423.015825:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817280 00000100:00100000:2.0:1788463423.015899:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:2.0:1788463423.015911:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+26:11320:x1875339466817280:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463423.015933:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463423.015975:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767a7 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016025:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016040:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016054:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016324:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 28 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016347:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 27 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.016357:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:2.0:1788463423.016361:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463423.016365:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812c00, rc 0) 00000100:00100000:2.0:1788463423.016462:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+27:11320:x1875339466817280:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 553us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463423.016470:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:0.0:1788463423.029103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.030283:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817536 00000100:00100000:1.0:1788463423.030302:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817536 00000100:00100000:1.0:1788463423.030388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 85 00000100:00100000:1.0:1788463423.030399:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+27:11320:x1875339466817536:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463423.030530:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.030554:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.030597:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463423.032304:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788463423.032340:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 462483764120ns, next at 463483758284ns, rc = 0 00000004:00010000:1.0:1788463423.032449:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0b8b9dc reply state 0000000070f14b47 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.032475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.032486:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463423.032500:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788463423.032506:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463423.032704:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+29:11320:x1875339466817536:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 2301us (3608us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788463423.032714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 85 00000100:00100000:0.0:1788463423.039301:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.039562:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817664 00000100:00100000:1.0:1788463423.039594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817664 00000100:00100000:1.0:1788463423.039680:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 86 00000100:00100000:1.0:1788463423.039695:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+29:11320:x1875339466817664:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463423.039728:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463423.039759:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767ae expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.039851:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.039896:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.039922:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463423.039926:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463423.039930:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463423.040014:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+30:11320:x1875339466817664:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 322us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463423.040022:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 86 00000100:00100000:0.0:1788463423.047162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.047814:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817792 00000100:00100000:1.0:1788463423.047831:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817792 00000100:00100000:1.0:1788463423.047905:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:1.0:1788463423.047916:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466817792:12345-192.168.204.53@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788463423.047979:0:9857:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1788463423.048028:0:9857:0:(genops.c:1385:class_connect()) connect: client 68497686-852f-43ff-8be6-586d5980ece4, cookie 0x841acb7f42a39d62 00002000:00100000:1.0:1788463423.048069:0:9857:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68497686-852f-43ff-8be6-586d5980ece4/ffff961781da9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463423.048093:0:9857:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463423.048889:0:9857:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463423.048964:0:9857:0:(import.c:65:import_set_state_nolock()) ffff96188f414800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463423.049059:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2399:x1875339466817792:12345-192.168.204.53@tcp:8:lhsmtool_posix.0 Request processed in 1140us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463423.049071:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:3.0:1788463423.052702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.052809:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466817920 00000100:00100000:0.0:1788463423.052823:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466817920 00000100:00100000:0.0:1788463423.052907:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:0.0:1788463423.052921:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:0:x1875339466817920:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788463423.053560:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788463423.067277:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1788463423.067301:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000100:00100000:2.0:1788463423.067931:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:0:x1875339466817920:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 15000us (15226us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788463423.067955:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:0.0:1788463423.077987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.078107:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466818176 00000100:00100000:2.0:1788463423.078120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466818176 00000100:00100000:2.0:1788463423.078322:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463423.078336:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+30:11320:x1875339466818176:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788463423.078709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+31:11320:x1875339466818176:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 374us (733us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788463423.078717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463423.085824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.085876:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466818432 00000100:00100000:2.0:1788463423.085899:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466818432 00000100:00100000:2.0:1788463423.085980:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 87 00000100:00100000:2.0:1788463423.085992:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+31:11320:x1875339466818432:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463423.086155:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+31:11320:x1875339466818432:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463423.086165:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 87 00000100:00100000:0.0:1788463423.092274:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.092430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466818560 00000100:00100000:1.0:1788463423.092444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466818560 00000100:00100000:1.0:1788463423.092631:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 88 00000100:00100000:1.0:1788463423.092645:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+31:11320:x1875339466818560:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463423.092673:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463423.092701:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39d69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767b5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092800:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092818:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092834:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463423.092895:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463423.092919:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092951:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39d69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767b5 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092973:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767b5 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.092984:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463423.092987:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463423.092992:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463423.094258:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+32:11320:x1875339466818560:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 1604us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463423.094293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 88 00000100:00100000:3.0:1788463423.100728:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.100804:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466818688 00000100:00100000:1.0:1788463423.100819:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466818688 00000100:00100000:1.0:1788463423.100894:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:1.0:1788463423.100906:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466818688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463423.100931:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463423.100958:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767bc expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463423.100993:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c93f, blocks: 0x0 00010000:00010000:1.0:1788463423.101019:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1788463423.101030:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463423.101043:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 6 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.101069:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 6 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.101087:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0cc00, rc 0) 00000100:00100000:1.0:1788463423.101196:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466818688:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 291us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463423.101214:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00010000:00010000:3.0:1788463423.112826:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463423.114047:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.114163:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466818944 00000100:00100000:0.0:1788463423.114177:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466818944 00000100:00100000:0.0:1788463423.114250:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 89 00000100:00100000:0.0:1788463423.114271:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+32:11320:x1875339466818944:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788463423.114446:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+32:11320:x1875339466818944:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 185us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.114454:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 89 00000100:00100000:0.0:1788463423.127117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.127208:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819072 00000100:00100000:3.0:1788463423.127222:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819072 00000100:00100000:3.0:1788463423.127298:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:3.0:1788463423.127321:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:11320:x1875339466819072:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463423.127347:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463423.127371:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767c3 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.127427:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.127439:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463423.127444:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463423.127451:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.127512:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.127530:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.127551:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485786112:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463423.127704:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.135210:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485786112:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463423.135278:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.135306:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:0.0:1788463423.135409:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:11320:x1875339466819072:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 8100us (8308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.135421:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:0.0:1788463423.148009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.156651:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819200 00000100:00100000:1.0:1788463423.156680:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819200 00010000:00010000:1.0:1788463423.156754:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.156840:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:1.0:1788463423.156853:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466819200:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463423.156886:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463423.156922:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.156941:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.156972:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d77 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767bc expref: 7 pid: 9857 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.156990:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463423.156996:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463423.157008:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.157020:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.157078:0:6552:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 6 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.157096:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6552:1875339485786240:192.168.204.53@tcp:105: 00000100:00100000:1.0:1788463423.157222:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.176414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.181066:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6552:1875339485786240:192.168.204.53@tcp:105: 00010000:00010000:2.0:1788463423.181108:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463423.181217:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466819200:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 24364us (33222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463423.181231:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:3.0:1788463423.184112:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819328 00000100:00100000:3.0:1788463423.184134:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819328 00002000:00100000:3.0:1788463423.184211:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff961787f21500 x1875339466819328/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:559/0 lens 504/0 e 0 to 0 dl 1788463434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463423.184223:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961787f21500 with x1875339466819328 ext(0->8) 00002000:00010000:3.0:1788463423.184231:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961787f21500 00000100:00100000:3.0:1788463423.184301:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:3.0:1788463423.184313:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466819328:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788463423.199113:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466819328:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 Request processed in 14792us (22704us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788463423.199128:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00002000:00100000:3.0:1788463423.199142:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff961787f21500 x1875339466819328/t4294967303(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:559/0 lens 504/448 e 0 to 0 dl 1788463434 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463423.199153:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961787f21500 with x1875339466819328 ext(0->8) 00002000:00010000:3.0:1788463423.199161:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961787f21500 00000100:00100000:0.0:1788463423.209134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.209176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819456 00000100:00100000:0.0:1788463423.209186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819456 00000100:00100000:0.0:1788463423.209243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 90 00000100:00100000:0.0:1788463423.209254:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+32:11320:x1875339466819456:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788463423.213591:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788463423.213618:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788463423.213652:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788463423.215276:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+16:11320:x1875339466819456:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 6011us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.215293:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 90 00000100:00100000:3.0:1788463423.215916:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463423.215943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485786368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788463423.216025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788463423.219116:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788463423.219137:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1788463423.219158:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219171:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219179:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219186:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.219192:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219202:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219220:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:0.0:1788463423.219224:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463423.219229:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219236:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a39c51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219261:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219268:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219274:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219300:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.219304:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219311:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219320:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:0.0:1788463423.219323:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788463423.219326:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.219331:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39d54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.222833:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485786368 00000100:00100000:1.0:1788463423.222855:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485786368 00000100:00100000:1.0:1788463423.226187:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788463423.226206:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485786368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788463423.226409:0:9857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788463423.226414:0:9857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788463423 00002000:00010000:1.0:1788463423.226418:0:9857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788463423.226420:0:9857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788463423 -> 1788463423 00002000:00010000:1.0:1788463423.226423:0:9857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788463423.226791:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485786368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 588us (10765us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788463423.226800:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788463423.226934:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96188f9dd180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788463423.226942:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485786368:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788463423.233400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463423.234236:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.234303:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819584 00000100:00100000:0.0:1788463423.234313:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819584 00000100:00100000:0.0:1788463423.234374:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:0.0:1788463423.234386:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2403:x1875339466819584:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788463423.246395:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788463423.246419:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788463423.246651:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466819584:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 12260us (12420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.246664:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:3.0:1788463423.263177:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.263232:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819840 00000100:00100000:3.0:1788463423.263245:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819840 00000100:00100000:3.0:1788463423.263341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:3.0:1788463423.263354:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+14:11320:x1875339466819840:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463423.263437:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463423.263475:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a39d70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767b5 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.263515:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:3.0:1788463423.263522:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463423.263611:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.263628:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.263639:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463423.263998:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd9d384b reply state 0000000091925aef transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.264013:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.264020:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:3.0:1788463423.264022:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463423.264025:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463423.264156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+15:11320:x1875339466819840:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 803us (994us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788463423.264164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:2.0:1788463423.269706:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.269899:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466819968 00000100:00100000:3.0:1788463423.269918:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466819968 00000100:00100000:3.0:1788463423.270008:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:3.0:1788463423.270022:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466819968:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463423.270245:0:9857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788463423.270249:0:9857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788463423 -> 1788463422 00002000:00010000:3.0:1788463423.270252:0:9857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788463420 00002000:00010000:3.0:1788463423.270254:0:9857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788463423 -> 1788463422 00002000:00010000:3.0:1788463423.273423:0:9857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788463423.273604:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466819968:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 3557us (3881us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788463423.273623:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:2.0:1788463423.300675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.300772:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820224 00000100:00100000:3.0:1788463423.300784:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820224 00000100:00100000:3.0:1788463423.300850:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:3.0:1788463423.300872:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+15:11320:x1875339466820224:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788463423.301066:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.301085:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 15 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.301096:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.301138:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 15 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.301152:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 15 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.301168:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485786496:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463423.301277:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463423.308652:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485786496:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463423.308683:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463423.309128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.309323:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820352 00000100:00100000:1.0:1788463423.309339:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820352 00010000:00010000:1.0:1788463423.309402:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 16 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.309456:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:1.0:1788463423.309468:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+16:2400:x1875339466820352:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463423.309500:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463423.309509:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 16 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309546:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 16 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309623:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a39d4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767a7 expref: 16 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309645:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463423.309652:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309850:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309860:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.309896:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463423.309970:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.309978:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+15:2400:x1875339466820352:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 506us (845us total) trans 0 rc 0/0 00010000:00010000:3.0:1788463423.310001:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310045:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310053:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310061:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310067:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463423.310072:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310080:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.310098:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00010000:00010000:3.0:1788463423.310120:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:3.0:1788463423.310127:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788463423.310133:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.310140:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39d8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.310222:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+14:11320:x1875339466820224:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 Request processed in 9361us (9555us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788463423.310242:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:0.0:1788463423.318784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.318885:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820480 00000100:00100000:1.0:1788463423.318905:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820480 00000100:00100000:1.0:1788463423.319004:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:1.0:1788463423.319019:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466820480:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788463423.319086:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.319148:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.319157:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463423.319163:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463423.319169:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.319221:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.319239:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 7 pid: 8441 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.319258:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485786624:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463423.319385:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.328805:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.328918:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485786624:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463423.328950:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.329105:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820608 00000100:00100000:3.0:1788463423.329113:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820608 00010000:00010000:3.0:1788463423.329151:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 8 pid: 8441 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.329193:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:3.0:1788463423.329202:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466820608:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463423.329216:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463423.329237:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 8 pid: 8441 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.329251:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 8 pid: 8441 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.329273:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecb6a79d/0x841acb7f42a39d7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767c3 expref: 8 pid: 8441 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.329287:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463423.329292:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463423.329298:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.329308:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.329357:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463423.329401:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466820608:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 200us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.329410:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00010000:00010000:0.0:1788463423.329620:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329630:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329663:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329672:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329680:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329687:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463423.329692:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329701:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329717:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.329724:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013a9c607/0x841acb7f42a39d93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463423.329778:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466820480:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 10764us (11004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.329787:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:0.0:1788463423.333676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.333767:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820864 00000100:00100000:2.0:1788463423.333788:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820864 00000100:00100000:2.0:1788463423.333851:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 93 00000100:00100000:2.0:1788463423.333861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+14:11320:x1875339466820864:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463423.333950:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.333968:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 14 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.333978:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.334016:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 14 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.334030:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 14 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463423.334043:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485786752:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463423.334134:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463423.342838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463423.342875:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466820992 00000100:00100000:2.0:1788463423.342883:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466820992 00010000:00010000:2.0:1788463423.342925:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 15 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463423.342975:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:2.0:1788463423.342986:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+15:2401:x1875339466820992:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463423.343002:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463423.343008:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 15 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.343022:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 15 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.343043:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463423.343048:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.343058:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.343066:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.343084:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463423.343128:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+15:2401:x1875339466820992:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 144us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463423.343134:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00010000:00010000:0.0:1788463423.344642:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a39bda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47674c expref: 14 pid: 10067 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463423.344665:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485786752:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463423.344697:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344706:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344712:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344924:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344938:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344946:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344981:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.344996:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 14 pid: 6524 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463423.345010:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485786880:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463423.345087:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.355412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.355515:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485786880:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463423.355552:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.355691:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821120 00000100:00100000:3.0:1788463423.355700:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821120 00010000:00010000:3.0:1788463423.355740:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 15 pid: 6524 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.355782:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:3.0:1788463423.355793:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+15:2400:x1875339466821120:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463423.355809:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463423.355816:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 15 pid: 6524 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355830:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 15 pid: 6524 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355853:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39d5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ae expref: 15 pid: 6524 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355867:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:3.0:1788463423.355872:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355882:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355901:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.355932:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463423.355984:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+14:2400:x1875339466821120:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 192us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.355991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00010000:00010000:0.0:1788463423.356140:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.356148:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463423.356262:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788463423.356381:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788463423.356418:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788463423.356510:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875339485787008:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463423.356561:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463423.356618:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463423.356726:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485787008 00000100:00100000:3.0:1788463423.356732:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485787008 00000100:00100000:3.0:1788463423.356848:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788463423.356857:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875339485787008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788463423.356934:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875339485787008:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.356942:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788463423.357025:0:6522:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788463423.357032:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96188f9dd180, transno 4294967304 00000100:00100000:1.0:1788463423.357050:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875339485787008:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788463423.357180:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788463423.357234:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875339485787136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788463423.357267:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463423.357292:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.357336:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485787136 00000100:00100000:0.0:1788463423.357342:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485787136 00000100:00100000:0.0:1788463423.357375:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788463423.357383:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875339485787136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463423.357474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875339485787136:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (205us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788463423.357480:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788463423.357550:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787149500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875339485787136:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788463423.357604:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357612:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357619:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357625:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463423.357629:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357636:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463423.357653:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463423.357657:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357664:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39da1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357692:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357698:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357711:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357717:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463423.357721:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357727:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357734:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463423.357736:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463423.357739:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357745:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a39cd6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357767:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357779:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 17 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357788:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357813:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 17 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.357838:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 17 pid: 12162 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.357849:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485787264:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463423.357903:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618884fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463423.368703:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463423.370082:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485787264:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463423.370112:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463423.376609:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821248 00000100:00100000:2.0:1788463423.376623:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821248 00010000:00010000:2.0:1788463423.376674:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 18 pid: 12162 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463423.376734:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:2.0:1788463423.376746:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+18:2400:x1875339466821248:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463423.376764:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463423.376772:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 18 pid: 12162 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376805:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 18 pid: 12162 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376828:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39cf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476792 expref: 18 pid: 12162 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376846:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:2.0:1788463423.376851:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376860:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376868:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463423.376900:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463423.376975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+17:2400:x1875339466821248:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 231us (8281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463423.376983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00010000:00010000:1.0:1788463423.379437:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379456:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379472:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379480:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379499:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379505:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463423.379509:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379516:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379550:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463423.379553:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463423.379559:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.379565:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39da8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380216:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380226:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380231:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380238:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463423.380242:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380249:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380259:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961885469e00) 00010000:00010000:1.0:1788463423.380262:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463423.380265:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463423.380272:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39d9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463423.380554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+16:11320:x1875339466820864:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 46688us (46882us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788463423.380565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 93 00000020:00080000:1.0:1788463423.380599:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788463423.381514:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463423.381530:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463423.381549:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788463423.381554:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463423.384961:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.385231:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821504 00000100:00100000:3.0:1788463423.385241:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821504 00000100:00100000:3.0:1788463423.385329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463423.385340:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+16:11320:x1875339466821504:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788463423.386012:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788463423.386046:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788463423.386082:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386099:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386112:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386138:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386144:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386151:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.386232:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788463423.386334:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+18:11320:x1875339466821504:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 993us (1381us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788463423.386342:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000020:00080000:3.0:1788463423.386347:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463423.386927:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463423.386936:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.386944:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfc00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463423.386948:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.386966:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.386980:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:0.0:1788463423.386983:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463423.386988:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.386995:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a39daf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.387008:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463423.387009:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463423.387011:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463423.667506:0:14224:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463423.667517:0:14224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463423.667544:0:14224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788463423.667554:0:14224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463423.731175:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.731225:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.731253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.731270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.731292:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.731320:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821888 00000100:00100000:0.0:1788463423.731331:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821888 00000100:00100000:0.0:1788463423.731396:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:0.0:1788463423.731407:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466821888:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463423.731488:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466821888:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 73us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.731503:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:0.0:1788463423.731527:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822144 00000100:00100000:0.0:1788463423.731531:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822144 00000100:00100000:0.0:1788463423.731571:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821760 00000100:00100000:0.0:1788463423.731598:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821760 00000100:00100000:0.0:1788463423.731621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822016 00000100:00100000:0.0:1788463423.731624:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822016 00000100:00100000:0.0:1788463423.731638:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 334 00000100:00100000:0.0:1788463423.731644:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466822144:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463423.731672:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466822144:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.731679:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 334 00000100:00100000:0.0:1788463423.731692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 335 00000100:00100000:0.0:1788463423.731699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466821760:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463423.731720:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466821760:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.731727:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 335 00000100:00100000:0.0:1788463423.731738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 336 00000100:00100000:0.0:1788463423.731744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466822016:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463423.731766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466822016:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463423.731773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 336 00000100:00100000:3.0:1788463423.731981:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466821632 00000100:00100000:3.0:1788463423.731987:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466821632 00000100:00100000:3.0:1788463423.732038:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 392 00000100:00100000:3.0:1788463423.732045:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466821632:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463423.732079:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466821632:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 35us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.732085:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 392 00000100:00080000:3.0:1788463423.732119:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463423.732123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463423.732126:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463423.862374:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.862410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822400 00000100:00100000:3.0:1788463423.862421:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822400 00000100:00100000:3.0:1788463423.862491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 94 00000100:00100000:3.0:1788463423.862512:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+18:11330:x1875339466822400:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463423.862540:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463423.862561:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767ca expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.862707:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39dbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.862721:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.862734:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39dbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463423.862744:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788463423.862846:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ca expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.862863:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39dbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ca expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.862873:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463423.862876:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463423.862880:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfa00, rc 0) 00000100:00100000:3.0:1788463423.862941:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+20:11330:x1875339466822400:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 432us (579us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788463423.862948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 94 00000100:00100000:2.0:1788463423.880559:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463423.881526:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822528 00000100:00100000:3.0:1788463423.881538:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822528 00000100:00100000:3.0:1788463423.881675:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 95 00000100:00100000:3.0:1788463423.881687:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+20:11330:x1875339466822528:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:3.0:1788463423.881769:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881786:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881797:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881813:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881820:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881828:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881901:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881910:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881916:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463423.881961:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.881975:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882378:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882385:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882391:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463423.882395:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882403:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882416:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463423.882419:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463423.882424:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882430:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39dcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882442:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882448:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882454:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882459:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463423.882468:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882487:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882496:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9618b7c44600) 00010000:00010000:3.0:1788463423.882499:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463423.882502:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882508:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39dd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882525:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882531:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882537:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882542:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463423.882545:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882551:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.882558:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9618b7c44200) 00010000:00010000:3.0:1788463423.882561:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463423.882570:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463423.885559:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39dd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463423.885689:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+20:11330:x1875339466822528:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 3998us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463423.885700:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 95 00000100:00100000:3.0:1788463423.990203:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.993138:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822784 00000100:00100000:0.0:1788463423.993155:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822784 00000100:00100000:0.0:1788463423.993239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 96 00000100:00100000:0.0:1788463423.993271:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+20:11333:x1875339466822784:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463423.993294:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463423.993319:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39de0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767d1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993403:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993419:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993430:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993446:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993452:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993458:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993652:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993661:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993674:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463423.993694:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788463423.993770:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993779:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993786:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993792:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.993796:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993803:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993814:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463423.993817:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463423.993820:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993826:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a39de7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993837:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993843:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993860:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993865:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463423.993868:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993875:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993883:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b400) 00010000:00010000:0.0:1788463423.993886:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463423.993889:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993894:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a39dee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993938:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a39de0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993951:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.993959:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463423.993961:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463423.993963:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1a00, rc 0) 00000100:00100000:0.0:1788463423.994047:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+22:11333:x1875339466822784:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 783us (3859us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788463423.994063:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 96 00000100:00100000:3.0:1788463423.999544:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463423.999725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466822912 00000100:00100000:0.0:1788463423.999737:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466822912 00000100:00100000:0.0:1788463423.999810:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 97 00000100:00100000:0.0:1788463423.999821:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+22:11333:x1875339466822912:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:0.0:1788463423.999897:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.999913:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.999925:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.999962:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.999970:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463423.999976:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.000249:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.000255:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.000262:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.000273:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.000289:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463424.000295:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.000302:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463424.000384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+22:11333:x1875339466822912:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 564us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463424.000392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 97 00000100:00100000:2.0:1788463424.010366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463424.010461:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466823168 00000100:00100000:3.0:1788463424.010481:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466823168 00000100:00100000:3.0:1788463424.010564:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463424.010604:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+22:11333:x1875339466823168:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463424.010820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+23:11333:x1875339466823168:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 245us (462us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788463424.010827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00080000:0.0:1788463424.011188:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463424.100965:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.101095:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466823424 00000100:00100000:0.0:1788463424.101106:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466823424 00000100:00100000:0.0:1788463424.101179:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 98 00000100:00100000:0.0:1788463424.101191:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+23:10859:x1875339466823424:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463424.101217:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.101239:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767d8 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.101359:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.101376:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.101386:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.101421:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.101452:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 24 pid: 6523 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463424.101466:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485787392:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463424.101620:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463424.107974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.108201:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466823552 00000100:00100000:2.0:1788463424.108212:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466823552 00010000:00010000:2.0:1788463424.108267:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 25 pid: 6523 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463424.108309:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463424.108322:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+25:2400:x1875339466823552:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463424.108338:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463424.108345:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 25 pid: 6523 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.108361:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 25 pid: 6523 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.108384:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:2.0:1788463424.108390:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.108401:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.108409:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.108430:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463424.108510:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+25:2400:x1875339466823552:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 190us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463424.108519:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00010000:00010000:0.0:1788463424.109031:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39df5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d1 expref: 24 pid: 6523 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463424.109053:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485787392:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463424.109078:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.109088:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.109094:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463424.109117:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788463424.109257:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 25 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.109271:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 24 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.109279:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.109289:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788463424.109292:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0600, rc 0) 00000100:00100000:0.0:1788463424.109343:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+24:10859:x1875339466823424:12345-192.168.204.53@tcp:101:bash.0 Request processed in 8154us (8390us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788463424.109350:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 98 00000100:00100000:3.0:1788463424.117494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.117624:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466823680 00000100:00100000:0.0:1788463424.117635:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466823680 00000100:00100000:0.0:1788463424.117695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 99 00000100:00100000:0.0:1788463424.117705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+24:10859:x1875339466823680:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463424.117730:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.117750:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767df expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117793:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39e26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117808:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39e26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117820:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39e26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117939:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767df expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117958:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39e26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767df expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.117967:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.117987:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463424.117992:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1a00, rc 0) 00000100:00100000:0.0:1788463424.118046:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+25:10859:x1875339466823680:12345-192.168.204.53@tcp:101:bash.0 Request processed in 341us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463424.118053:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 99 00000100:00100000:2.0:1788463424.122694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.123193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466823936 00000100:00100000:0.0:1788463424.123207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466823936 00000100:00100000:0.0:1788463424.123271:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 100 00000100:00100000:0.0:1788463424.123281:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+25:10859:x1875339466823936:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:0.0:1788463424.123545:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.123562:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.123602:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463424.123647:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788463424.123670:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000362b89b8 reply state 00000000d6602bf0 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.123685:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.123693:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.123696:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463424.123699:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788463424.123739:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788463424.123855:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+29:10859:x1875339466823936:12345-192.168.204.53@tcp:36:bash.0 Request processed in 575us (1171us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788463424.123879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 100 00000020:00080000:0.0:1788463424.123884:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788463424.127848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.128335:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824064 00000100:00100000:0.0:1788463424.128347:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824064 00000100:00100000:0.0:1788463424.128422:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 101 00000100:00100000:0.0:1788463424.128432:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+29:10859:x1875339466824064:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463424.128456:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.128490:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767e6 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.128550:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767e6 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.128566:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767e6 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.132520:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463424.132920:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:1.0:1788463424.133404:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463424.133409:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0c00, rc 0) 00000100:00100000:1.0:1788463424.133508:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+30:10859:x1875339466824064:12345-192.168.204.53@tcp:101:bash.0 Request processed in 5072us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463424.133517:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 101 00000100:00100000:1.0:1788463424.146678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.146774:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824192 00000100:00100000:0.0:1788463424.146785:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824192 00000100:00100000:0.0:1788463424.146849:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:0.0:1788463424.146859:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:10859:x1875339466824192:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463424.146878:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.146902:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767ed expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463424.146936:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a99c93e, atime: 0x6a99c93c, ctime: 0x6a99c93e, blocks: 0x8 00010000:00010000:0.0:1788463424.146961:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788463424.146998:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463424.147007:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.147027:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.147040:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0a00, rc 0) 00000100:00100000:0.0:1788463424.147100:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:10859:x1875339466824192:12345-192.168.204.53@tcp:101:bash.0 Request processed in 243us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463424.147107:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:2.0:1788463424.154097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463424.154325:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824320 00000100:00100000:1.0:1788463424.154337:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824320 00002000:00010000:1.0:1788463424.154382:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788463424.154387:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b24a80 with x1875339466824320 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463424.154400:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9618c1b24a80. 00000100:00100000:1.0:1788463424.154439:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:1.0:1788463424.154450:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466824320:12345-192.168.204.53@tcp:10:bash.0 00002000:00010000:1.0:1788463424.154794:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788463424.154798:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788463422 -> 1788463424 00002000:00010000:1.0:1788463424.154801:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788463420 -> 1788463420 00002000:00010000:1.0:1788463424.154803:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788463422 -> 1788463424 00002000:00010000:1.0:1788463424.154805:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788463424.154868:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466824320:12345-192.168.204.53@tcp:10:bash.0 Request processed in 420us (780us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788463424.154887:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00002000:00010000:1.0:1788463424.154891:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788463424.154893:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b24a80 with x1875339466824320 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463424.154898:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9618c1b24a80. 00000100:00100000:1.0:1788463424.316462:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.320426:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824448 00000100:00100000:2.0:1788463424.320444:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824448 00000100:00100000:2.0:1788463424.320544:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:2.0:1788463424.320557:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+30:11348:x1875339466824448:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:2.0:1788463424.320705:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320726:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320740:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320768:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320775:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320781:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320870:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320900:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320908:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463424.320972:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.320996:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321003:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321011:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321018:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463424.321024:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321033:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321049:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463424.321052:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463424.321058:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321064:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39e42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321088:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321094:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321099:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321105:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463424.321108:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321114:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321122:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961894655e00) 00010000:00010000:2.0:1788463424.321125:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463424.321127:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321133:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a39e49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321149:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321156:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321161:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321173:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463424.321176:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321182:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321191:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:2.0:1788463424.321193:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463424.321196:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.321201:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a39e50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463424.321295:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+30:11348:x1875339466824448:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 740us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463424.321303:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:1.0:1788463424.389728:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485787520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463424.389815:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463424.389936:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485787520 00000100:00100000:2.0:1788463424.389944:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485787520 00000100:00100000:2.0:1788463424.390019:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788463424.390033:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485787520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463424.390057:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788463424.390101:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485787520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463424.390109:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788463424.390301:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463424.390339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485787520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463424.408845:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.408957:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824704 00000100:00100000:0.0:1788463424.408968:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824704 00000100:00100000:0.0:1788463424.409038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 103 00000100:00100000:0.0:1788463424.409049:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+30:11351:x1875339466824704:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463424.409070:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.409093:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a39e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767f4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409199:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409216:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409227:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409243:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409258:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409265:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409382:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39e6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409391:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409398:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39e6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463424.409407:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788463424.409495:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409503:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409509:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409514:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.409518:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409527:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409552:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463424.409555:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463424.409559:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409566:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409611:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409618:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409624:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409630:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.409632:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409639:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409646:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:0.0:1788463424.409649:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463424.409652:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409657:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a39e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409709:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a39e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767f4 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409724:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39e6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767f4 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.409732:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.409734:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788463424.409736:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0e00, rc 0) 00000100:00100000:0.0:1788463424.409906:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+32:11351:x1875339466824704:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 858us (1073us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788463424.409915:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 103 00000100:00100000:3.0:1788463424.419126:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463424.422153:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466824832 00000100:00100000:1.0:1788463424.422169:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466824832 00000100:00100000:1.0:1788463424.422523:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00100000:1.0:1788463424.422535:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+32:11351:x1875339466824832:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463424.422621:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.422638:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 32 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.422648:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.422685:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 32 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.422698:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 32 pid: 12162 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463424.422730:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485787648:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463424.422857:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463424.429288:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485787648:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463424.429321:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463424.429674:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.430078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466825088 00000100:00100000:2.0:1788463424.430086:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466825088 00000100:00100000:2.0:1788463424.430155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463424.430166:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+33:6172:x1875339466825088:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788463424.430447:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+34:6172:x1875339466825088:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 282us (773us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788463424.430455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:1.0:1788463424.435536:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463424.435659:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466825216 00000100:00100000:3.0:1788463424.435670:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466825216 00010000:00010000:3.0:1788463424.435714:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 34 pid: 12162 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463424.435769:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:3.0:1788463424.435782:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+34:2400:x1875339466825216:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463424.435798:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463424.435805:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 34 pid: 12162 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435819:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 34 pid: 12162 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435841:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a39e11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767d8 expref: 34 pid: 12162 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435858:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:3.0:1788463424.435862:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435872:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435879:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.435911:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463424.436231:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+33:2400:x1875339466825216:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 202us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463424.436250:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00010000:00010000:1.0:1788463424.436705:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436714:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436770:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436778:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436784:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436791:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463424.436795:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436804:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436816:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:1.0:1788463424.436819:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463424.436824:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.436843:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39e7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463424.436906:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+32:11351:x1875339466824832:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 14372us (17788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463424.436914:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00100000:1.0:1788463424.440072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.440263:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466825472 00000100:00100000:2.0:1788463424.440274:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466825472 00000100:00100000:2.0:1788463424.440333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:2.0:1788463424.440343:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+32:11351:x1875339466825472:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:2.0:1788463424.440605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+33:11351:x1875339466825472:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 230us (511us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788463424.440613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463424.578378:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.579415:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466825728 00000100:00100000:0.0:1788463424.579428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466825728 00000100:00100000:0.0:1788463424.579508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 105 00000100:00100000:0.0:1788463424.579520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+33:11362:x1875339466825728:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:0.0:1788463424.579548:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.579629:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4767fb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579705:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579720:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579734:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579760:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579767:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579774:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579874:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a39e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579884:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a39e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.579891:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a39e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463424.579900:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788463424.580247:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580256:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580263:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580269:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.580273:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580293:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580305:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463424.580308:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463424.580313:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580320:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580335:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580340:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580346:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580352:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.580354:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580360:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580367:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:0.0:1788463424.580369:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463424.580372:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580433:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39e81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767fb expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580447:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a39e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767fb expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.580454:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.580456:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463424.580470:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0400, rc 0) 00000100:00100000:0.0:1788463424.581106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+35:11362:x1875339466825728:12345-192.168.204.53@tcp:101:cat.0 Request processed in 1586us (2735us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788463424.581115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 105 00000100:00100000:1.0:1788463424.597033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.608270:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466825984 00000100:00100000:2.0:1788463424.608286:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466825984 00000100:00100000:2.0:1788463424.608366:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:2.0:1788463424.608377:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+35:11362:x1875339466825984:12345-192.168.204.53@tcp:35:cat.0 00000100:00100000:2.0:1788463424.608751:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+36:11362:x1875339466825984:12345-192.168.204.53@tcp:35:cat.0 Request processed in 375us (11728us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788463424.608760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463424.643331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.643500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466826240 00000100:00100000:0.0:1788463424.643511:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466826240 00000100:00100000:0.0:1788463424.643570:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 106 00000100:00100000:0.0:1788463424.643627:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+36:11363:x1875339466826240:12345-192.168.204.53@tcp:36:rm.0 00010000:00010000:0.0:1788463424.643681:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788463424.643707:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a39e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767e6 expref: 36 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643729:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a39e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767fb expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643760:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39e6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767f4 expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643771:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39e26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767df expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643781:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.643785:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463424.643805:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643817:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643827:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643841:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643847:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643853:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643922:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643931:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.643943:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463424.644147:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788463424.644155:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464095579886ns, next at 465095577853ns, rc = 0 00010000:00010000:0.0:1788463424.644209:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644218:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644226:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644233:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644240:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644247:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644267:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463424.644284:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644290:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644296:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644308:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.644312:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644320:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644329:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:0.0:1788463424.644332:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788463424.644335:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644341:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39eb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644355:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644361:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644367:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644372:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463424.644375:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.644381:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644437:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463424.644452:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644474:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463424.644480:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644491:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644511:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:3.0:1788463424.644514:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788463424.644519:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644526:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a39eb9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.644544:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463424.644547:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463424.644549:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463424.646101:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463424.646104:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463424.646111:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.646119:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463424.646138:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025d6df49 reply state 000000007f61b8c4 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.646150:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.646157:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:0.0:1788463424.646159:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463424.646162:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463424.646271:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+34:11363:x1875339466826240:12345-192.168.204.53@tcp:36:rm.0 Request processed in 2630us (2934us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788463424.646281:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 106 00000100:00100000:3.0:1788463424.736183:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463424.736774:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466826496 00000100:00100000:1.0:1788463424.736792:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466826496 00000100:00100000:1.0:1788463424.736896:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 107 00000100:00100000:1.0:1788463424.736910:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+34:11369:x1875339466826496:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463424.736946:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463424.736976:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a39ec0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476802 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737130:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737148:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737165:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737180:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737226:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.737677:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463424.738612:0:12162:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788463424.739324:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739345:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739359:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739410:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739418:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739426:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739433:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463424.739438:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739447:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739490:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:1.0:1788463424.739494:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463424.739500:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739506:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39ec7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463424.739525:0:12162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e3385e4 reply state 00000000432d5f94 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739539:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739546:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:1.0:1788463424.739548:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463424.739552:0:12162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788463424.739905:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a39ec0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 37 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739926:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 36 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463424.739936:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463424.739938:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463424.739942:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463424.740055:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+37:11369:x1875339466826496:12345-192.168.204.53@tcp:101:bash.0 Request processed in 3147us (3889us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788463424.740065:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 107 00000100:00100000:0.0:1788463424.747661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.747792:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466826624 00000100:00100000:2.0:1788463424.747807:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466826624 00000100:00100000:2.0:1788463424.747897:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:2.0:1788463424.748104:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466826624:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463424.748132:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463424.748233:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476809 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463424.748296:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463424.748324:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1788463424.748329:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463424.748341:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.748369:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463424.748386:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:2.0:1788463424.748477:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466826624:12345-192.168.204.53@tcp:101:bash.0 Request processed in 566us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463424.748486:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:2.0:1788463424.753722:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463424.753855:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466826752 00000100:00100000:3.0:1788463424.753868:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466826752 00000100:00100000:3.0:1788463424.754094:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:3.0:1788463424.754108:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+8:11369:x1875339466826752:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463424.754133:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463424.754261:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476810 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.754305:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.754315:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463424.754320:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463424.754327:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.754375:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.754392:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463424.754409:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875339485787776:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463424.754554:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463424.758667:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875339485787776:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463424.758722:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 9 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.759451:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:3.0:1788463424.759634:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+9:11369:x1875339466826752:12345-192.168.204.53@tcp:101:bash.0 Request processed in 5526us (6075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463424.759669:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:2.0:1788463424.760608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463424.761432:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466826880 00000100:00100000:3.0:1788463424.761449:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466826880 00010000:00010000:3.0:1788463424.761521:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463424.761599:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:3.0:1788463424.761612:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466826880:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463424.761631:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463424.761664:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.761681:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.761711:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a39ee3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476809 expref: 9 pid: 8440 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.761735:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463424.761740:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463424.761887:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.761901:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463424.766727:0:6552:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463424.766773:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6552:1875339485787904:192.168.204.53@tcp:105: 00000100:00100000:3.0:1788463424.766896:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463424.777785:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6552:1875339485787904:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463424.777826:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463424.777906:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466826880:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 16294us (17301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463424.777920:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:0.0:1788463424.779888:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463424.780055:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466827136 00000100:00100000:2.0:1788463424.780069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466827136 00000100:00100000:2.0:1788463424.780252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:2.0:1788463424.780266:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+37:11369:x1875339466827136:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:2.0:1788463424.780739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+38:11369:x1875339466827136:12345-192.168.204.53@tcp:35:bash.0 Request processed in 475us (864us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788463424.780756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463424.902363:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463424.902396:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485788032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463424.902509:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463424.907204:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485788032 00000100:00100000:0.0:1788463424.907227:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485788032 00000100:00100000:0.0:1788463424.907320:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788463424.907334:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485788032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463424.907381:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463424.907501:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485788032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (4992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463424.907546:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788463424.908730:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485788032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463424.996054:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463424.996513:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466827264 00000100:00100000:0.0:1788463424.996527:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466827264 00000100:00100000:0.0:1788463424.996648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 108 00000100:00100000:0.0:1788463424.996663:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+38:11385:x1875339466827264:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463424.996698:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463424.996730:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476817 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.996838:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.996856:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.996871:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463424.996943:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788463424.996948:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463424.996973:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.997003:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a39ef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476817 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.997027:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476817 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463424.997066:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463424.997070:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463424.997075:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0000, rc 0) 00000100:00100000:0.0:1788463424.997156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+39:11385:x1875339466827264:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 495us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463424.997163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 108 00000100:00100000:3.0:1788463425.001254:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463425.001625:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466827520 00000100:00100000:0.0:1788463425.001638:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466827520 00000100:00100000:0.0:1788463425.001717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 109 00000100:00100000:0.0:1788463425.001729:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+39:11385:x1875339466827520:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463425.001767:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463425.001794:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39eff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47681e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.002060:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39f06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.002077:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.002091:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39f06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463425.002106:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788463425.002566:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a39eff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47681e expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.004525:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39f06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47681e expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.004537:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:0.0:1788463425.004540:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463425.004544:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0e00, rc 0) 00000100:00100000:0.0:1788463425.004666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+41:11385:x1875339466827520:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2936us (3437us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788463425.004676:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 109 00000100:00100000:1.0:1788463425.010766:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.010845:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466827648 00000100:00100000:3.0:1788463425.010858:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466827648 00000100:00100000:3.0:1788463425.010966:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463425.010979:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+41:2401:x1875339466827648:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463425.011000:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463425.011033:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a39f06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47681e expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.011056:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:3.0:1788463425.011062:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463425.011366:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+40:2401:x1875339466827648:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 388us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.011375:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:2.0:1788463425.017045:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463425.017467:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466827904 00000100:00100000:1.0:1788463425.017481:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466827904 00000100:00100000:1.0:1788463425.017561:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 110 00000100:00100000:1.0:1788463425.017607:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+40:11385:x1875339466827904:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463425.017643:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463425.017674:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39f14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476825 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.018059:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.018078:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.018093:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463425.018254:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788463425.018513:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a39f14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476825 expref: 43 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.018533:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476825 expref: 42 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.018564:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463425.018567:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788463425.018823:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0cc00, rc 0) 00000100:00100000:1.0:1788463425.018970:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+42:11385:x1875339466827904:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1398us (1941us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788463425.018979:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 110 00000100:00100000:0.0:1788463425.027821:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463425.028066:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828032 00000100:00100000:2.0:1788463425.028080:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828032 00000100:00100000:2.0:1788463425.028208:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:2.0:1788463425.028227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466828032:12345-192.168.204.53@tcp:1:lfs.0 00010000:00010000:2.0:1788463425.028294:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.028321:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.028331:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463425.028336:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463425.028341:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.028390:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.028408:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 8 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463425.028424:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485788160:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463425.028567:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463425.035388:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.035825:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828160 00000100:00100000:3.0:1788463425.035840:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828160 00002000:00100000:3.0:1788463425.035924:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff96188553ed80 x1875339466828160/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:561/0 lens 504/0 e 0 to 0 dl 1788463436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463425.035939:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188553ed80 with x1875339466828160 ext(0->8) 00010000:00010000:3.0:1788463425.035951:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 9 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.035971:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 9 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463425.035979:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96188553ed80 00000100:00100000:3.0:1788463425.036023:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:3.0:1788463425.036034:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466828160:12345-192.168.204.53@tcp:4:lfs.0 00000100:00100000:2.0:1788463425.036781:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485788160:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463425.036819:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788463425.038704:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463425.040812:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+11:2400:x1875339466828160:12345-192.168.204.53@tcp:4:lfs.0 Request processed in 4763us (5424us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788463425.040836:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00002000:00100000:0.0:1788463425.040854:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff96188553ed80 x1875339466828160/t4294967303(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:561/0 lens 504/448 e 0 to 0 dl 1788463436 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463425.040866:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188553ed80 with x1875339466828160 ext(0->8) 00010000:00010000:0.0:1788463425.040880:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.040905:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463425.040926:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96188553ed80 00000100:00100000:0.0:1788463425.048824:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463425.049117:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828288 00000100:00100000:2.0:1788463425.049131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828288 00010000:00010000:2.0:1788463425.049194:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463425.049300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:2.0:1788463425.049313:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+11:2403:x1875339466828288:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463425.049335:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788463425.049361:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788463425.049364:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788463425 00002000:00010000:2.0:1788463425.049367:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788463425 00002000:00010000:2.0:1788463425.049369:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788463425 00002000:00010000:2.0:1788463425.049372:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788463425.049381:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.049399:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.049429:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecb6a79d/0x841acb7f42a39eea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476810 expref: 11 pid: 8439 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.049460:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463425.049467:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463425.049474:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.049507:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.049552:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463425.049679:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+10:2403:x1875339466828288:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 367us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.049687:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00010000:00010000:0.0:1788463425.050029:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050041:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050070:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050078:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050086:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050093:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463425.050098:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050108:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050122:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.050130:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a39f29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.050206:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466828032:12345-192.168.204.53@tcp:1:lfs.0 Request processed in 21987us (22634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463425.050216:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:0.0:1788463425.054403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.054656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828544 00000100:00100000:3.0:1788463425.054672:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828544 00000100:00100000:3.0:1788463425.054764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:3.0:1788463425.054777:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+42:11385:x1875339466828544:12345-192.168.204.53@tcp:35:lfs.0 00000004:00010000:3.0:1788463425.054865:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476825 expref: 42 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463425.055136:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788463425.055171:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788463425.055659:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788463425.055707:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.055725:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 46 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.055741:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.055788:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 46 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.055805:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 46 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.055822:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485788288:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463425.055967:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463425.066400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463425.066504:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828672 00000100:00100000:2.0:1788463425.066517:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828672 00010000:00010000:2.0:1788463425.066624:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 47 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463425.066670:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:2.0:1788463425.066684:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+47:2401:x1875339466828672:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463425.066703:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463425.066711:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 47 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.066728:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 47 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.066928:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:2.0:1788463425.066941:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.066954:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.066981:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.067007:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463425.067078:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+47:2401:x1875339466828672:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 398us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.067087:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00010000:00010000:3.0:1788463425.068836:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39ed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476802 expref: 46 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.068869:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485788288:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463425.068905:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.069028:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.069035:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463425.069380:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788463425.069541:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788463425.070033:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485788416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463425.070163:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463425.070215:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463425.070440:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485788416 00000100:00100000:2.0:1788463425.070461:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485788416 00000100:00100000:2.0:1788463425.070552:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788463425.070565:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485788416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788463425.070703:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485788416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.070712:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788463425.071106:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485788416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788463425.071282:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788463425.071355:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485788544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463425.071398:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463425.071418:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db840 going to sleep for 11 seconds 00000100:00080000:3.0:1788463425.071435:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463425.071505:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485788544 00000100:00100000:1.0:1788463425.071511:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485788544 00000100:00100000:1.0:1788463425.071554:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788463425.071563:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485788544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788463425.071755:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6526:x1875339485788544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 193us (356us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788463425.071763:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788463425.071805:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485788544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788463425.071852:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788463425.071894:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.071907:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.071916:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.071923:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463425.071930:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.071969:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.071992:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463425.071996:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788463425.072002:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.072010:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a39f30 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463425.072141:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788463425.072224:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788463425.072241:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464523665082ns, next at 465523661659ns, rc = 0 00000001:00080000:1.0:1788463425.072248:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788463425.072275:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463425.072279:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788463425.072286:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476825 expref: 50 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463425.072410:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+49:11385:x1875339466828544:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 17636us (18024us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788463425.072418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000020:00080000:1.0:1788463425.072422:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788463425.077075:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463425.077123:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466828800 00000100:00100000:2.0:1788463425.077140:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466828800 00000100:00100000:2.0:1788463425.077227:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 111 00000100:00100000:2.0:1788463425.077240:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+49:11385:x1875339466828800:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463425.077267:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463425.077315:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39f37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47682c expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.077376:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39f37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47682c expref: 50 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.077393:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39f37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47682c expref: 50 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.077426:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463425.077430:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463425.077435:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:2.0:1788463425.077537:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+50:11385:x1875339466828800:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 299us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.077545:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 111 00000001:00080000:3.0:1788463425.079612:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788463425.079628:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788463425.084842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463425.085013:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466829056 00000100:00100000:0.0:1788463425.085023:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466829056 00000100:00100000:0.0:1788463425.085128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463425.085138:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+50:11385:x1875339466829056:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463425.085387:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+51:11385:x1875339466829056:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 249us (564us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788463425.085395:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00010000:00010000:0.0:1788463425.158722:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463425.183387:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.183546:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466829184 00000100:00100000:3.0:1788463425.183560:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466829184 00000100:00100000:3.0:1788463425.183672:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 112 00000100:00100000:3.0:1788463425.183686:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+51:11395:x1875339466829184:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:3.0:1788463425.183808:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.183831:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.183846:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.183861:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.183870:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.183878:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184221:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184231:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184239:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463425.184304:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184321:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184330:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184337:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184345:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.184350:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184359:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184374:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463425.184378:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463425.184384:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184400:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39f3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184418:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184424:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184429:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184435:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.184438:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184445:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184467:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:3.0:1788463425.184470:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463425.184473:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184478:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184488:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184494:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184506:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184510:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.184513:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184519:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184527:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.184530:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463425.184532:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.184538:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.185174:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+51:11395:x1875339466829184:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 1481us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.185187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 112 00000100:00100000:2.0:1788463425.248012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463425.248299:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466829440 00000100:00100000:1.0:1788463425.248315:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466829440 00000100:00100000:1.0:1788463425.248398:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 113 00000100:00100000:1.0:1788463425.248409:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+51:11398:x1875339466829440:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463425.248467:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463425.248495:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476833 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248648:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248668:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248686:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248701:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248709:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248716:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248880:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248888:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.248896:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463425.251180:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788463425.251361:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251371:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251378:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251384:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0de00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463425.251389:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251398:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251418:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:1.0:1788463425.251422:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463425.251427:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251434:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a39f5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251467:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251473:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251479:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251495:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463425.251498:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251505:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251514:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:1.0:1788463425.251517:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463425.251520:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251526:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251635:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 54 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251653:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 53 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.251662:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463425.251664:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463425.251667:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463425.255744:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+53:11398:x1875339466829440:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 7316us (7727us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788463425.255760:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 113 00000100:00100000:2.0:1788463425.260208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.260305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466829568 00000100:00100000:3.0:1788463425.260319:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466829568 00000100:00100000:3.0:1788463425.260395:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 114 00000100:00100000:3.0:1788463425.260409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+53:11398:x1875339466829568:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:3.0:1788463425.260514:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.260538:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.260594:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.260645:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.260653:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.260661:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.265073:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.265105:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.265125:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.265152:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.265155:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463425.265162:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.265171:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.265329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+53:11398:x1875339466829568:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 4914us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.265341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 114 00000100:00100000:0.0:1788463425.269827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463425.269989:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466829824 00000100:00100000:1.0:1788463425.270023:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466829824 00000100:00100000:1.0:1788463425.270100:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:1.0:1788463425.270112:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+53:11398:x1875339466829824:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:1.0:1788463425.270456:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+54:11398:x1875339466829824:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 334us (634us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788463425.270464:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:2.0:1788463425.338780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.339011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830080 00000100:00100000:3.0:1788463425.339055:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830080 00000100:00100000:3.0:1788463425.339137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:3.0:1788463425.339149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+54:11408:x1875339466830080:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463425.339187:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463425.339191:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788463425.339227:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a39ef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476817 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339253:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463425.339259:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463425.339276:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47683a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339417:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339435:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 54 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339457:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339500:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 54 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.339516:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 54 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.339534:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788672:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463425.339746:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463425.348310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463425.348712:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830208 00000100:00100000:0.0:1788463425.348727:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830208 00010000:00010000:0.0:1788463425.348795:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 55 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.348853:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:0.0:1788463425.348866:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+55:2400:x1875339466830208:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463425.348886:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463425.348894:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 55 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.348942:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 55 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.348975:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:0.0:1788463425.348982:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.348994:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.349004:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.349031:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463425.349112:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+55:2400:x1875339466830208:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 248us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463425.349121:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 70 00010000:00010000:3.0:1788463425.352341:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a39f68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476833 expref: 54 pid: 12162 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.352375:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788672:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463425.352407:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.352420:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.352427:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463425.352471:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788463425.352728:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39f7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.352760:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.352770:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.352774:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463425.352779:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf000, rc 0) 00000100:00100000:3.0:1788463425.352860:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+54:11408:x1875339466830080:12345-192.168.204.53@tcp:101:bash.0 Request processed in 13712us (14096us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788463425.352871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:0.0:1788463425.361851:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463425.362130:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830336 00000100:00100000:1.0:1788463425.362144:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830336 00000100:00100000:1.0:1788463425.362221:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:1.0:1788463425.362235:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+54:11408:x1875339466830336:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463425.362268:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463425.362298:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476841 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362344:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362364:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362379:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362551:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a39f92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 56 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362626:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 55 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463425.362650:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463425.362654:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463425.362659:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d000, rc 0) 00000100:00100000:1.0:1788463425.362733:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+55:11408:x1875339466830336:12345-192.168.204.53@tcp:101:bash.0 Request processed in 500us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463425.362753:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:2.0:1788463425.367988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.375686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830592 00000100:00100000:3.0:1788463425.375731:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830592 00000100:00100000:3.0:1788463425.375831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 117 00000100:00100000:3.0:1788463425.375845:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+55:11408:x1875339466830592:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:3.0:1788463425.376833:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.376862:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.376876:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463425.377131:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788463425.377172:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1940b82 reply state 00000000fe6988de transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.377190:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.377199:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.377204:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463425.377210:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463425.377360:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+58:11408:x1875339466830592:12345-192.168.204.53@tcp:36:bash.0 Request processed in 1514us (9387us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788463425.377369:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 117 00000020:00080000:3.0:1788463425.377375:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788463425.392064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.392255:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830720 00000100:00100000:3.0:1788463425.392269:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830720 00000100:00100000:3.0:1788463425.392341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:3.0:1788463425.392352:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+58:11408:x1875339466830720:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463425.392403:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463425.392430:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39fa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476848 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.392552:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.392569:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.392604:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.392646:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.392660:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 59 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.392676:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788800:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463425.393285:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463425.402271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.402466:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788800:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463425.402507:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463425.403892:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466830848 00000100:00100000:2.0:1788463425.403920:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466830848 00010000:00010000:2.0:1788463425.403985:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 60 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463425.404040:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:2.0:1788463425.404052:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+60:2401:x1875339466830848:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463425.404073:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463425.404081:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 60 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404096:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 60 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404154:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a39f84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47683a expref: 60 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404177:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463425.404183:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404194:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463425.404241:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463425.404326:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+59:2401:x1875339466830848:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 275us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.404334:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 71 00010000:00010000:3.0:1788463425.405058:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.405070:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463425.405154:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788463425.405160:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463425.405190:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.405233:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39fa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.405255:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.405265:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.405268:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463425.405271:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:3.0:1788463425.405317:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+58:11408:x1875339466830720:12345-192.168.204.53@tcp:101:bash.0 Request processed in 12966us (13268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.405326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:0.0:1788463425.411019:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463425.411147:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831104 00000100:00100000:1.0:1788463425.411159:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831104 00000100:00100000:1.0:1788463425.411229:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:1.0:1788463425.411241:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+58:11408:x1875339466831104:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:1.0:1788463425.411555:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+59:11408:x1875339466831104:12345-192.168.204.53@tcp:35:bash.0 Request processed in 314us (549us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788463425.411563:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:2.0:1788463425.499261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463425.499462:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831232 00000100:00100000:0.0:1788463425.499479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831232 00000100:00100000:0.0:1788463425.499560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:0.0:1788463425.499623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+59:11414:x1875339466831232:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463425.499658:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463425.499689:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a39fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47684f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.499927:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.499946:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.499959:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463425.500021:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788463425.500025:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463425.500052:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.500085:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a39fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47684f expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.500491:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47684f expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.500503:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463425.500507:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463425.500512:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1800, rc 0) 00000100:00100000:0.0:1788463425.500764:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466831232:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1192us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463425.500774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:2.0:1788463425.504040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.504151:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831360 00000100:00100000:3.0:1788463425.504165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831360 00000100:00100000:3.0:1788463425.504243:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:3.0:1788463425.504256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466831360:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463425.504286:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463425.504316:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39fc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476856 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504410:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504461:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504477:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504492:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504499:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.504506:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505046:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505060:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505069:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463425.505125:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788463425.505130:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463425.505153:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505167:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505188:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505195:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505203:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505210:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.505216:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505225:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505243:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:3.0:1788463425.505246:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463425.505253:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505260:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a39fca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505280:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505287:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505294:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505306:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463425.505309:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505315:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505324:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:3.0:1788463425.505326:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463425.505329:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505335:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39fd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505372:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39fc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505388:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.505396:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.505398:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463425.505401:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdec00, rc 0) 00000100:00100000:3.0:1788463425.505666:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+61:11414:x1875339466831360:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1411us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.505676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:3.0:1788463425.511189:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463425.511306:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831616 00000100:00100000:0.0:1788463425.511320:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831616 00000100:00100000:0.0:1788463425.511410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:0.0:1788463425.511422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+61:11414:x1875339466831616:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463425.511462:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463425.511489:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a39fdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47685d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511671:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511690:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511698:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511707:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511763:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511778:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.511794:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788928:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463425.511945:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.511966:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 62 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.511977:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485789056:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463425.512006:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463425.513639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.513744:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831744 00000100:00100000:3.0:1788463425.513755:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831744 00010000:00010000:3.0:1788463425.513802:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 63 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.513852:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:3.0:1788463425.513864:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+63:2401:x1875339466831744:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463425.513880:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463425.513889:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 63 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.513903:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 63 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.513930:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.513936:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.513945:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.513951:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463425.514011:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+63:2401:x1875339466831744:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 148us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.514019:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:2.0:1788463425.516428:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.516695:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466831872 00000100:00100000:3.0:1788463425.516708:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466831872 00010000:00010000:3.0:1788463425.516768:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 63 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463425.516840:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:3.0:1788463425.516852:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+63:2401:x1875339466831872:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463425.516871:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463425.516878:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 63 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.516894:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 63 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.516929:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.516935:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.516946:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.516955:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.516980:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463425.517044:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+63:2401:x1875339466831872:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 194us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.517054:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 73 00010000:00010000:0.0:1788463425.517654:0:6524:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.53@tcp) returned -22 from blocking AST (req@00000000c6f99269 x1875339485788928) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.517674:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a39fd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476856 expref: 62 pid: 6523 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.517694:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485788928:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463425.517711:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a39fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476848 expref: 61 pid: 6524 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463425.517721:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485789056:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463425.517846:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:0.0:1788463425.517855:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.517866:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.517873:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463425.517929:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788463425.518099:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a39fdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.518118:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463425.518126:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:0.0:1788463425.518129:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788463425.518132:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1000, rc 0) 00000100:00100000:0.0:1788463425.518232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+61:11414:x1875339466831616:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 6812us (7059us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788463425.518241:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:2.0:1788463425.536721:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.536885:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832128 00000100:00100000:3.0:1788463425.537059:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832128 00000100:00100000:3.0:1788463425.537215:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463425.537230:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+61:11414:x1875339466832128:12345-192.168.204.53@tcp:103:lfs.0 00010000:00010000:3.0:1788463425.537261:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463425.537296:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a39f37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47682c expref: 61 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.537326:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.537333:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463425.537411:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466832128:12345-192.168.204.53@tcp:103:lfs.0 Request processed in 184us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.537419:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:2.0:1788463425.542218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.542636:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832256 00000100:00100000:3.0:1788463425.542650:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832256 00000100:00100000:3.0:1788463425.542726:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:3.0:1788463425.542746:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466832256:12345-192.168.204.53@tcp:58:lfs.0 00010000:00010000:3.0:1788463425.542959:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.542982:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.542999:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463425.543139:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788463425.543255:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466832256:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 511us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.543265:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:1.0:1788463425.547430:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463425.547632:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832384 00000100:00100000:3.0:1788463425.547646:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832384 00000100:00100000:3.0:1788463425.547744:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:3.0:1788463425.547758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+60:11414:x1875339466832384:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463425.547787:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463425.547814:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476864 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.547888:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.548399:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.548428:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.548459:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.548478:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463425.548481:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463425.548485:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463425.548495:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf400, rc 0) 00000100:00100000:3.0:1788463425.548689:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+61:11414:x1875339466832384:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 932us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.548698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:0.0:1788463425.924176:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485789312:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924413:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924512:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485789824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924538:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924562:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485790336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924620:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924650:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788463425.924656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485789440:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924685:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485789952:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924719:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485790464:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.924867:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463425.924902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789312 00000100:00100000:0.0:1788463425.924911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789312 00000100:00100000:2.0:1788463425.925024:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485789184:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925068:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925097:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485789696:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925123:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925152:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485790208:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925181:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925198:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485790720:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925220:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925320:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788463425.925331:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485789568:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925358:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925373:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485790080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925395:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925413:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485790592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925446:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463425.925482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789184 00000100:00100000:2.0:1788463425.925486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789184 00000100:00100000:2.0:1788463425.925549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788463425.925560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.925660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485789184:12345-0@lo:400:kworker.0 Request processed in 100us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.925668:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788463425.925709:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790208 00000100:00100000:2.0:1788463425.925713:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790208 00000100:00100000:0.0:1788463425.925855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789824 00000100:00100000:0.0:1788463425.925860:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789824 00000100:00100000:0.0:1788463425.925884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790336 00000100:00100000:0.0:1788463425.925887:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790336 00000100:00100000:0.0:1788463425.925902:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789952 00000100:00100000:0.0:1788463425.925904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789952 00000100:00100000:3.0:1788463425.926054:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790720 00000100:00100000:3.0:1788463425.926068:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790720 00000100:00100000:3.0:1788463425.926095:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790080 00000100:00100000:3.0:1788463425.926098:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790080 00000100:00100000:3.0:1788463425.926110:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790592 00000100:00100000:3.0:1788463425.926112:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790592 00000100:00100000:3.0:1788463425.926130:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788463425.926137:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485790720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926183:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485790720:12345-0@lo:400:kworker.0 Request processed in 47us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926189:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788463425.926202:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788463425.926207:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926233:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485790080:12345-0@lo:400:kworker.0 Request processed in 26us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926239:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788463425.926264:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788463425.926271:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485790592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926297:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485790592:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788463425.926336:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790464 00000100:00100000:3.0:1788463425.926340:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790464 00000100:00100000:3.0:1788463425.926359:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789568 00000100:00100000:3.0:1788463425.926362:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789568 00000100:00100000:3.0:1788463425.926373:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788463425.926379:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485789312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926423:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485789312:12345-0@lo:400:kworker.0 Request processed in 44us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926453:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788463425.926471:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788463425.926476:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926507:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485789824:12345-0@lo:400:kworker.0 Request processed in 32us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926513:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788463425.926526:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788463425.926532:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485790336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926557:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485790336:12345-0@lo:400:kworker.0 Request processed in 27us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926562:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788463425.926590:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788463425.926597:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485789952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926622:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485789952:12345-0@lo:400:kworker.0 Request processed in 26us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926628:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788463425.926638:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788463425.926643:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485790464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926666:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485790464:12345-0@lo:400:kworker.0 Request processed in 23us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463425.926671:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788463425.926680:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788463425.926686:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463425.926711:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485789568:12345-0@lo:400:kworker.0 Request processed in 26us (1352us total) trans 0 rc 0/0 00010000:00080000:0.0:1788463425.927034:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b2f100 x1875339485789952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463425.927051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485789952:0@lo:400:kworker.0 00010000:00080000:0.0:1788463425.927064:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b2fb80 x1875339485790464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463425.927072:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485790464:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.927087:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485789312:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.927098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485789824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.927109:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485790336:0@lo:400:kworker.0 00000100:00080000:0.0:1788463425.927153:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463425.927159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463425.927161:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463425.927164:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463425.927195:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485789568:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.927207:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485790080:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.927237:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485790592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.927569:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788463425.927595:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485790208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463425.927659:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485790208:12345-0@lo:400:kworker.0 Request processed in 69us (2478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463425.927666:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788463425.928055:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788463425.928421:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485789184:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.928451:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485790208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.928466:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788463425.928473:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1788463425.928525:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96188d1c1f80, transno 4294967302 00000004:00080000:0.0:1788463425.928540:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1788463425.928555:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485790720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463425.928869:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463425.928887:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485790848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463425.928961:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463425.929009:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789440 00000100:00100000:1.0:1788463425.929016:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789440 00000100:00100000:1.0:1788463425.929063:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485789696 00000100:00100000:1.0:1788463425.929066:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485789696 00000100:00100000:1.0:1788463425.929083:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788463425.929091:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485789440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463425.929141:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485789440:12345-0@lo:400:kworker.0 Request processed in 50us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463425.929167:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788463425.929184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788463425.929191:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463425.929240:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485789696:12345-0@lo:400:kworker.0 Request processed in 49us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463425.929258:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788463425.929309:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790848 00000100:00100000:1.0:1788463425.929313:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790848 00000100:00100000:1.0:1788463425.929341:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463425.929347:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485790848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463425.929384:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1788463425.929422:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485790848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463425.929430:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463425.929466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485790976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463425.929490:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463425.929529:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485790848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463425.929556:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485790976 00000100:00100000:1.0:1788463425.929559:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485790976 00000100:00100000:1.0:1788463425.929602:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788463425.929609:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485790976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463425.929619:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1788463425.929650:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485790976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463425.929656:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788463425.929693:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485790976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463425.929731:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485789440:0@lo:400:kworker.0 00000100:00100000:0.0:1788463425.930655:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485789696:0@lo:400:kworker.0 00010000:00010000:2.0:1788463426.180544:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463426.436348:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463426.436360:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463426.436420:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788463426.436446:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463426.436656:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485791104:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463426.436790:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.437105:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463426.437177:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.437320:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485791232 00000100:00100000:0.0:1788463426.437330:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485791232 00000100:00100000:0.0:1788463426.437394:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788463426.437405:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485791232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463426.437457:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788463426.437530:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485791232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.437538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788463426.437670:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463426.443860:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485791104:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463426.444495:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.444757:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832512 00000100:00100000:0.0:1788463426.444767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832512 00000100:00100000:0.0:1788463426.444862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:0.0:1788463426.444874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+61:11415:x1875339466832512:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463426.445081:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788463426.445941:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463426.446330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+61:11415:x1875339466832512:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 1447us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.446370:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:1.0:1788463426.454650:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.454843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832640 00000100:00100000:0.0:1788463426.454857:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832640 00000100:00100000:3.0:1788463426.455335:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:3.0:1788463426.455353:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+61:11415:x1875339466832640:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788463426.455500:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455523:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455538:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455558:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455566:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455601:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455631:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455641:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455671:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463426.455749:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788463426.455755:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463426.455770:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455783:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455790:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455798:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455805:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.455811:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455820:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455835:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:3.0:1788463426.455838:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463426.455844:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455851:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a002 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.455878:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456012:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456019:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456025:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdee00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.456028:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456035:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456044:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff961885469400) 00010000:00010000:3.0:1788463426.456046:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463426.456049:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456055:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a009 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456072:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456078:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456085:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456097:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.456100:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456437:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456447:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463426.456450:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463426.456454:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.456461:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.456994:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+61:11415:x1875339466832640:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 1225us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.457007:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:3.0:1788463426.460787:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463426.461650:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466832896 00000100:00100000:2.0:1788463426.461666:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466832896 00000100:00100000:2.0:1788463426.461757:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:2.0:1788463426.461769:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+61:11415:x1875339466832896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463426.461796:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463426.461823:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a017 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47686b expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.461999:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462019:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462033:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463426.462047:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463426.462154:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462189:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462198:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462205:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463426.462210:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462221:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462249:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463426.462253:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463426.462260:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462267:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a01e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462323:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a017 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47686b expref: 63 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462336:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463426.462339:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463426.462343:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a017 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47686b expref: 63 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.462354:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812000, rc 0) 00000100:00100000:2.0:1788463426.462463:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466832896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 696us (1691us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788463426.462473:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:2.0:1788463426.469772:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.470103:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466833024 00000100:00100000:0.0:1788463426.470119:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466833024 00000100:00100000:0.0:1788463426.470201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:0.0:1788463426.470213:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466833024:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463426.470273:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463426.470450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466833024:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 239us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.470458:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:0.0:1788463426.475210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.476161:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466833280 00000100:00100000:1.0:1788463426.476179:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466833280 00000100:00100000:1.0:1788463426.476274:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:1.0:1788463426.476286:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466833280:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463426.476320:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463426.476323:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463426.476362:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a39fbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47684f expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.476389:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:1.0:1788463426.476396:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463426.476414:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a02c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476872 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463426.477080:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788463426.477272:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.477290:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.477304:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.477375:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a02c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476872 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.477417:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476872 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.477438:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9d900) 00010000:00010000:1.0:1788463426.477442:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463426.477445:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ca00, rc 0) 00000100:00100000:1.0:1788463426.477541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+63:11415:x1875339466833280:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 1257us (2346us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788463426.477551:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:2.0:1788463426.483668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.491535:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466833536 00000100:00100000:0.0:1788463426.491559:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466833536 00000100:00100000:0.0:1788463426.491688:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:0.0:1788463426.491702:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+63:11415:x1875339466833536:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463426.491796:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463426.491833:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476872 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.491860:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9d900) 00010000:00010000:0.0:1788463426.491874:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463426.491915:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.491933:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.491968:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.491988:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.491996:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492004:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492063:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492071:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492078:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492084:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463426.492090:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492098:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492106:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463426.492109:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463426.492113:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492127:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a041 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492140:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492147:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492153:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492158:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463426.492162:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492169:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492178:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x8c638b25 (ffff961787b9b100) 00010000:00010000:0.0:1788463426.492181:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463426.492184:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.492190:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a048 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x8c638b25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.493878:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466833536:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 2160us (10301us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463426.493894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:2.0:1788463426.497990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.498090:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466833664 00000100:00100000:1.0:1788463426.498104:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466833664 00000100:00100000:1.0:1788463426.498183:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:1.0:1788463426.498196:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+62:11415:x1875339466833664:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463426.498222:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463426.498254:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a04f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476879 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498304:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498322:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498337:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498510:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a04f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 64 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498543:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 63 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.498552:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:1.0:1788463426.498555:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463426.498560:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463426.498666:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+63:11415:x1875339466833664:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 473us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.498674:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:1.0:1788463426.501786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.501952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466833920 00000100:00100000:0.0:1788463426.501968:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466833920 00000100:00100000:0.0:1788463426.502046:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:0.0:1788463426.502060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+63:11415:x1875339466833920:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463426.502182:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.502205:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.502220:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463426.502612:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788463426.502624:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465954048387ns, next at 466954044985ns, rc = 0 00000004:00010000:0.0:1788463426.502693:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e683aae reply state 00000000b94be0e1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.502710:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.502730:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:0.0:1788463426.502734:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788463426.502738:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463426.504033:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+65:11415:x1875339466833920:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 1961us (2249us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788463426.504050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:2.0:1788463426.507707:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.507837:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834048 00000100:00100000:0.0:1788463426.507853:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834048 00000100:00100000:0.0:1788463426.507948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:0.0:1788463426.507961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+65:11415:x1875339466834048:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463426.508018:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463426.508050:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476880 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.508136:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.508154:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.508178:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:0.0:1788463426.508182:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463426.508186:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0400, rc 0) 00000100:00100000:0.0:1788463426.508378:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+66:11415:x1875339466834048:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 418us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.508386:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:2.0:1788463426.510898:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.511049:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834176 00000100:00100000:3.0:1788463426.511063:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834176 00000100:00100000:3.0:1788463426.511157:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:3.0:1788463426.511170:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466834176:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788463426.511484:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466834176:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 315us (600us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788463426.511494:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00080000:2.0:1788463426.513467:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463426.517792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.517939:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834432 00000100:00100000:3.0:1788463426.517971:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834432 00000100:00100000:3.0:1788463426.518050:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:3.0:1788463426.518064:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+66:11415:x1875339466834432:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788463426.518683:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+67:11415:x1875339466834432:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 618us (904us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788463426.518692:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463426.528741:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.534144:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834688 00000100:00100000:3.0:1788463426.534169:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834688 00000100:00100000:3.0:1788463426.534348:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:3.0:1788463426.534363:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:11415:x1875339466834688:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788463426.534706:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:11415:x1875339466834688:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 344us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.534714:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:2.0:1788463426.541809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.542022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834816 00000100:00100000:1.0:1788463426.542037:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834816 00000100:00100000:1.0:1788463426.542122:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:1.0:1788463426.542135:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+67:11415:x1875339466834816:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463426.542166:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463426.542199:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a06b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476887 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542311:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542332:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542347:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463426.542436:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463426.542464:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542497:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a06b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476887 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542517:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476887 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.542528:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:1.0:1788463426.542531:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463426.542535:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463426.542652:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+68:11415:x1875339466834816:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 520us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.542661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:1.0:1788463426.552252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.552433:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466834944 00000100:00100000:3.0:1788463426.552448:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466834944 00000100:00100000:3.0:1788463426.552518:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:3.0:1788463426.552531:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466834944:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463426.552556:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463426.552623:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47688e expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463426.552657:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c942, blocks: 0x0 00010000:00010000:3.0:1788463426.552682:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=466s v=(0 0) 00010000:00010000:3.0:1788463426.552687:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463426.552700:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 10 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.552746:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 10 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.552764:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:3.0:1788463426.552851:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466834944:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 322us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.552859:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:2.0:1788463426.556196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.558669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835200 00000100:00100000:0.0:1788463426.558693:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835200 00000100:00100000:0.0:1788463426.558801:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:0.0:1788463426.558820:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+68:11415:x1875339466835200:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788463426.559005:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+68:11415:x1875339466835200:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 186us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.559014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:2.0:1788463426.565632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.566070:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835328 00000100:00100000:3.0:1788463426.566085:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835328 00000100:00100000:3.0:1788463426.566163:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:3.0:1788463426.566175:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+10:11415:x1875339466835328:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463426.566199:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463426.566227:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476895 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.566268:0:9857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 11 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.566278:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463426.566284:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463426.566290:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 11 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.566337:0:9857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 11 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.566372:0:9857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 11 pid: 8439 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.566389:0:9857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9857:1875339485791360:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463426.566535:0:9857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617870956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.580730:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463426.581023:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835456 00000100:00100000:2.0:1788463426.581033:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835456 00000100:00100000:3.0:1788463426.581054:0:9857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9857:1875339485791360:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463426.581091:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 12 pid: 8439 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.581095:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 12 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.581133:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdee00, rc 0) 00000100:00100000:2.0:1788463426.581142:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:2.0:1788463426.581153:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+12:2401:x1875339466835456:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463426.581171:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463426.581198:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 12 pid: 8439 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.581211:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+12:11415:x1875339466835328:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 15039us (15641us total) trans 0 rc 0/0 00010000:00010000:2.0:1788463426.581214:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 12 pid: 8439 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.581219:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00010000:00010000:2.0:1788463426.581524:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3a079 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47688e expref: 11 pid: 8439 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.581561:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463426.581566:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463426.581626:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 10 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.581638:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 10 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.581681:0:9527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 10 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.581698:0:9527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9527:1875339485791488:192.168.204.53@tcp:105: 00000100:00100000:2.0:1788463426.581891:0:9527:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787b96b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.591695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463426.591928:0:9527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9527:1875339485791488:192.168.204.53@tcp:105: 00010000:00010000:2.0:1788463426.591964:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463426.592043:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+10:2401:x1875339466835456:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 10890us (11328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.592058:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:0.0:1788463426.592631:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835584 00000100:00100000:0.0:1788463426.592640:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835584 00002000:00100000:0.0:1788463426.592699:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9617884f2a00 x1875339466835584/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:562/0 lens 504/0 e 0 to 0 dl 1788463437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463426.592735:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884f2a00 with x1875339466835584 ext(0->12) 00002000:00010000:0.0:1788463426.592742:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884f2a00 00000100:00100000:0.0:1788463426.592771:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463426.592782:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+10:2402:x1875339466835584:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788463426.594354:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+12:2402:x1875339466835584:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 Request processed in 1561us (2664us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788463426.594369:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00002000:00100000:0.0:1788463426.594384:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9617884f2a00 x1875339466835584/t4294967309(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:562/0 lens 504/448 e 0 to 0 dl 1788463437 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463426.594395:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884f2a00 with x1875339466835584 ext(0->12) 00002000:00010000:0.0:1788463426.594401:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884f2a00 00000100:00100000:1.0:1788463426.601465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.606003:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835712 00000100:00100000:3.0:1788463426.606025:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835712 00000100:00100000:3.0:1788463426.606126:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:3.0:1788463426.606139:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+68:11415:x1875339466835712:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788463426.611191:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788463426.611218:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788463426.611283:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788463426.611317:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9618829c6cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788463426.611323:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618901bfc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9618829c6c00 00000020:00080000:0.0:1788463426.611326:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618901bf600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961787d8a400 00000004:00080000:0.0:1788463426.611356:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788463426.611384:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961898b45180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788463426.611387:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96178708ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961898b45540 00000020:00080000:0.0:1788463426.611390:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96178708c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961889dfac00 00000020:00080000:0.0:1788463426.611443:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788463426.611449:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463426.611477:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485791616:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788463426.611533:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788463426.611563:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485791744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788463426.611594:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.611738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.611793:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463426.611800:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485791872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788463426.612093:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485791616 00000100:00100000:2.0:1788463426.612102:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485791616 00000100:00100000:2.0:1788463426.612164:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485791744 00000100:00100000:2.0:1788463426.612168:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485791744 00000100:00100000:2.0:1788463426.612193:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463426.612205:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485791616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788463426.612266:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1788463426.612303:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.612333:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.612344:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788463426.612349:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463426.612355:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.612391:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.612408:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 11 pid: 8439 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.612432:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485792000:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463426.612443:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463426.612454:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875339485791744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463426.612510:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a240 going to sleep for 11 seconds 00002000:00010000:3.0:1788463426.612598:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788463426.612608:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788463427 00002000:00010000:3.0:1788463426.612611:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463426.612613:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788463426 -> 1788463427 00002000:00010000:3.0:1788463426.612616:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788463426.612664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1875339485791744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (925us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788463426.612672:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463426.612799:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+22:11415:x1875339466835712:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 6662us (11354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.612809:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:0.0:1788463426.613114:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788463426.613171:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96178854e680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788463426.613179:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485791744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463426.613190:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485791872 00000100:00100000:2.0:1788463426.613196:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485791872 00000100:00100000:2.0:1788463426.613224:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463426.613233:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485791872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788463426.613250:0:9857:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788463426.613284:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a99c941, atime: 0x6a99c941, ctime: 0x6a99c941, blocks: 0x8 00010000:00010000:2.0:1788463426.613298:0:9857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.613311:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=466s v=(0 0) 00010000:00010000:2.0:1788463426.613315:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463426.613322:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.613341:0:9857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.613353:0:9857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.613362:0:9857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.613396:0:9857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463426.614123:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463426.614135:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.614336:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463426.614342:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.614353:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.614376:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.614384:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a375499/0x841acb7f42a3a08e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614441:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.614443:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463426.614445:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463426.614447:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463426.614451:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614457:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614474:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.614479:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614486:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614502:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff961894655100) 00010000:00010000:1.0:1788463426.614505:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463426.614510:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614515:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a39d85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614541:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614547:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614553:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614557:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.614560:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614565:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614629:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff961787b9ba00) 00010000:00010000:1.0:1788463426.614631:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463426.614635:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614640:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a39e2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614658:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614665:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614672:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614677:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.614680:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614686:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614695:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:1.0:1788463426.614697:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463426.614701:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614706:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a39eab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614790:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614797:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614866:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614872:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.614874:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614880:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614890:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9b700) 00010000:00010000:1.0:1788463426.614892:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463426.614895:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.614902:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a39ece lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615003:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615009:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615014:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615025:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.615028:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615034:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615044:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463426.615046:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463426.615048:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615053:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a39fa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615066:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615071:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615077:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615081:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463426.615084:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615089:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615106:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:1.0:1788463426.615109:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463426.615112:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.615117:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a05d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.615128:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485791872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1892us (2011us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788463426.615137:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1788463426.615223:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961882fa3b80/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788463426.615310:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485791872:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788463426.616774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.616862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835840 00000100:00100000:3.0:1788463426.616875:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835840 00000100:00100000:3.0:1788463426.616945:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:3.0:1788463426.616956:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+12:2401:x1875339466835840:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788463426.623275:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485792000:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463426.623325:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463426.628203:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788463426.628222:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788463426.630164:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466835840:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 13192us (13383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.630182:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:2.0:1788463426.632772:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.641553:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466835968 00000100:00100000:3.0:1788463426.641711:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466835968 00010000:00010000:0.0:1788463426.641894:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.641946:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:0.0:1788463426.641959:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466835968:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463426.641979:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463426.641986:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.642001:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.642056:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a39e3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ed expref: 7 pid: 8439 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.642077:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463426.642081:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463426.642089:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.642101:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.642144:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463426.642224:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466835968:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 267us (9465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.642232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00010000:00010000:1.0:1788463426.642337:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.642349:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.642361:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.642370:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.642399:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463426.642495:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.642659:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fe19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485791616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30455us (31083us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788463426.642668:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463426.642712:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836224 00000100:00100000:3.0:1788463426.642719:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836224 00000100:00100000:3.0:1788463426.642769:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:3.0:1788463426.642777:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+16:11415:x1875339466836224:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463426.642837:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463426.642917:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a072 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476887 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.642933:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:3.0:1788463426.642939:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463426.642979:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.642995:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.643018:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463426.643123:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081850809 reply state 00000000f3f6359e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.643134:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.643140:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:3.0:1788463426.643143:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463426.643145:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463426.643221:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000100:00100000:3.0:1788463426.643225:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+17:11415:x1875339466836224:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 449us (731us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788463426.643232:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 137 00000004:00080000:1.0:1788463426.643241:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1788463426.643265:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96178854e680, transno 4294967310 00000100:00100000:1.0:1788463426.643285:0:3650:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff96178854c700 x1875339485791616/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788463442 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788463426.643299:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96178854c700/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788463426.643305:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485791616:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788463426.643635:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463426.643645:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.643654:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463426.643659:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.643669:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.643698:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.643705:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c08e155b/0x841acb7f42a3a087 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.643791:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463426.643793:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463426.643794:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463426.645759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.645840:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836352 00000100:00100000:3.0:1788463426.645852:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836352 00000100:00100000:3.0:1788463426.645934:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:3.0:1788463426.645946:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466836352:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463426.646138:0:9857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788463426.646143:0:9857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788463427 -> 1788463425 00002000:00010000:3.0:1788463426.646145:0:9857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788463425 00002000:00010000:3.0:1788463426.646148:0:9857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788463427 -> 1788463425 00002000:00010000:3.0:1788463426.646150:0:9857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788463426.646228:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466836352:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 284us (483us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788463426.646237:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:2.0:1788463426.652387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.652468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836608 00000100:00100000:0.0:1788463426.652484:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836608 00000100:00100000:0.0:1788463426.652561:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:0.0:1788463426.652624:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+17:11415:x1875339466836608:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788463426.652728:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.652750:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 17 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.652760:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.652808:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 17 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.652825:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 17 pid: 10067 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.652867:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485792128:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463426.653012:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.655537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463426.655689:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836736 00000100:00100000:2.0:1788463426.655701:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836736 00010000:00010000:2.0:1788463426.655769:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 18 pid: 10067 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.655842:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:2.0:1788463426.655857:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+18:2401:x1875339466836736:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463426.655880:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463426.655889:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 18 pid: 10067 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.655913:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 18 pid: 10067 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.655943:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:2.0:1788463426.655948:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.655960:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.655969:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.655992:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463426.656005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476879 expref: 18 pid: 10067 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.656024:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485792128:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463426.656059:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+17:2401:x1875339466836736:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 206us (536us total) trans 0 rc 0/0 00010000:00010000:0.0:1788463426.656060:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.656067:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00010000:00010000:0.0:1788463426.656070:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656076:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656140:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656149:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656157:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656163:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463426.656169:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656190:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656201:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:0.0:1788463426.656203:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788463426.656208:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.656215:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a09c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.656263:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+16:11415:x1875339466836608:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 Request processed in 3692us (3892us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788463426.656271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:2.0:1788463426.664000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.665992:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836864 00000100:00100000:0.0:1788463426.666015:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836864 00000100:00100000:0.0:1788463426.666116:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:0.0:1788463426.666129:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466836864:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788463426.666198:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.666224:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 7 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.666235:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463426.666240:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463426.666246:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.666318:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 7 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.666337:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 7 pid: 9857 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.666357:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875339485792256:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463426.666499:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.668619:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8439:1875339485792256:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463426.668672:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.670873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.671003:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466836992 00000100:00100000:1.0:1788463426.671016:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466836992 00010000:00010000:1.0:1788463426.671072:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 8 pid: 9857 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463426.671129:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:1.0:1788463426.671142:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466836992:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463426.671161:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463426.671190:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 8 pid: 9857 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.671207:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 8 pid: 9857 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.671248:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fc5724/0x841acb7f42a3a080 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476895 expref: 8 pid: 9857 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.671295:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463426.671299:0:9527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463426.671307:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.671320:0:9527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.671358:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463426.671438:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466836992:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 297us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.671446:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 77 00010000:00010000:0.0:1788463426.671462:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671474:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671500:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671510:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671532:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671539:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463426.671545:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671555:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671569:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.671605:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3a0a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.671664:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466836864:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 5539us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.671673:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:1.0:1788463426.677440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.677566:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466837248 00000100:00100000:3.0:1788463426.677640:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466837248 00000100:00100000:3.0:1788463426.677732:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:3.0:1788463426.677745:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+16:11415:x1875339466837248:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788463426.677858:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.678240:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 16 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.678254:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.678300:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 16 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.678317:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 16 pid: 12162 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.678335:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792384:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463426.678556:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.690654:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792384:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463426.690699:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.695244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.695442:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466837376 00000100:00100000:3.0:1788463426.695456:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466837376 00010000:00010000:3.0:1788463426.695515:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 17 pid: 12162 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.695631:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:3.0:1788463426.695644:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+17:2400:x1875339466837376:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463426.695668:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463426.695677:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 17 pid: 12162 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695692:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 17 pid: 12162 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695721:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a39f99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476841 expref: 17 pid: 12162 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695739:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463426.695746:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695757:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695766:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695774:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.695812:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463426.695886:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+16:2400:x1875339466837376:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 245us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.695902:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 78 00010000:00010000:1.0:1788463426.696011:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696021:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696258:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696273:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696282:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696328:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.696344:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463426.696360:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792512:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463426.696446:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463426.703334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.703724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466837504 00000100:00100000:3.0:1788463426.703738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466837504 00010000:00010000:3.0:1788463426.703791:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.703833:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:3.0:1788463426.703846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+17:2401:x1875339466837504:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463426.703864:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463426.703873:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.703902:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 17 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.703933:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:3.0:1788463426.703940:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.703953:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.703962:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.703988:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463426.704062:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+17:2401:x1875339466837504:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 217us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.704081:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 79 00010000:00010000:1.0:1788463426.704254:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a064 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476880 expref: 16 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463426.704276:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792512:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463426.704306:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.704317:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.704323:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463426.704484:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788463426.704656:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788463426.704699:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788463426.704795:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485792640:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788463426.704860:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463426.704977:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463426.708468:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485792640 00000100:00100000:2.0:1788463426.708495:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485792640 00000100:00100000:2.0:1788463426.708600:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788463426.708613:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12162:x1875339485792640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463426.708808:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12162:x1875339485792640:12345-0@lo:1000:mdt00_004.0 Request processed in 197us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.708817:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788463426.711969:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485792640:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788463426.712249:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788463426.712396:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485792768:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788463426.712500:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463426.712548:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463426.712842:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485792768 00000100:00100000:2.0:1788463426.712852:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485792768 00000100:00100000:2.0:1788463426.713145:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788463426.713159:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12162:x1875339485792768:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463426.713441:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12162:x1875339485792768:12345-0@lo:1000:mdt00_004.0 Request processed in 285us (940us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788463426.713450:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788463426.724973:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485792768:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788463426.725067:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725082:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725090:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725097:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.725103:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725113:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725133:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:3.0:1788463426.725137:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463426.725144:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725150:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a0b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725185:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725192:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725223:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725228:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.725231:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725238:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725248:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463426.725250:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463426.725259:0:12162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725273:0:12162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725283:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.725337:0:12162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.725355:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792896:192.168.204.53@tcp:105: 00000100:00100000:3.0:1788463426.725486:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463426.737560:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463426.737705:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485792896:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463426.737775:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737787:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a39ff4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737832:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737850:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737865:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737876:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737883:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737890:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737895:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.737910:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737919:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737932:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463426.737941:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463426.737946:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737952:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a0b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737963:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737968:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737973:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737978:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdee00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463426.737980:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737986:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.737993:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463426.737996:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463426.737998:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.738004:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a0aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.738232:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+19:11415:x1875339466837248:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 60488us (60817us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788463426.738255:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 139 00000020:00080000:3.0:1788463426.738264:0:12162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788463426.739004:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463426.739012:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463426.739530:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788463426.739541:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463426.744411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.753000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466837632 00000100:00100000:0.0:1788463426.753024:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466837632 00000100:00100000:2.0:1788463426.753341:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466837888 00000100:00100000:2.0:1788463426.753348:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466837888 00000100:00100000:2.0:1788463426.753375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463426.753389:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+20:11414:x1875339466837632:12345-192.168.204.53@tcp:49:lfs.0 00000100:00100000:2.0:1788463426.753624:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+20:11414:x1875339466837632:12345-192.168.204.53@tcp:49:lfs.0 Request processed in 236us (16078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.753634:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:2.0:1788463426.753658:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463426.753667:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+19:11415:x1875339466837888:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788463426.754030:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788463426.754074:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788463426.754140:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754162:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754178:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754187:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754194:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754201:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.754233:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463426.754302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+21:11415:x1875339466837888:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 635us (9908us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788463426.754309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000020:00080000:2.0:1788463426.754313:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463426.755095:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463426.755107:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.755115:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463426.755130:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.755140:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.755157:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:0.0:1788463426.755160:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463426.755167:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.755173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.755193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463426.755196:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463426.755197:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463426.757252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.757346:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466838144 00000100:00100000:0.0:1788463426.757359:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466838144 00000100:00100000:0.0:1788463426.757446:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:0.0:1788463426.757459:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+21:11414:x1875339466838144:12345-192.168.204.53@tcp:58:lfs.0 00000040:00080000:0.0:1788463426.757770:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788463426.757877:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+21:11414:x1875339466838144:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 419us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.757886:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:3.0:1788463426.815475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463426.815749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466838272 00000100:00100000:0.0:1788463426.815763:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466838272 00000100:00100000:0.0:1788463426.815849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:0.0:1788463426.815861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+21:11417:x1875339466838272:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463426.815909:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463426.815957:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47689c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816066:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816084:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816098:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816114:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816122:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816128:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816231:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816242:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816251:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816295:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.816323:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 22 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.816342:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485793024:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463426.816487:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.824248:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875339485793024:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463426.824293:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.829021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463426.829359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466838528 00000100:00100000:2.0:1788463426.829374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466838528 00000100:00100000:2.0:1788463426.829472:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463426.829487:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+23:9944:x1875339466838528:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788463426.829856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+24:9944:x1875339466838528:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 371us (850us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788463426.829865:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:3.0:1788463426.833173:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463426.833382:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466838656 00000100:00100000:1.0:1788463426.833397:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466838656 00010000:00010000:1.0:1788463426.833463:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 24 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463426.833515:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 80 00000100:00100000:1.0:1788463426.833528:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+24:2401:x1875339466838656:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463426.833548:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463426.833557:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 24 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833617:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 24 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833649:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a39fe6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47685d expref: 24 pid: 6524 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833672:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463426.833699:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833722:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833732:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.833765:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463426.833848:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+23:2401:x1875339466838656:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 322us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.833857:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 80 00010000:00010000:0.0:1788463426.834002:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834011:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463426.834083:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788463426.834088:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463426.834129:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834146:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834159:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834167:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834187:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834194:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463426.834199:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834208:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834219:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:0.0:1788463426.834223:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463426.834227:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834234:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a0cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834247:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834253:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834259:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834265:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463426.834268:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834286:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834295:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff961787b9ae00) 00010000:00010000:0.0:1788463426.834298:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463426.834301:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a0d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834354:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47689c expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834370:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47689c expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.834378:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:0.0:1788463426.834380:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463426.834383:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0600, rc 0) 00000100:00100000:0.0:1788463426.834427:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+22:11417:x1875339466838272:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 18560us (18961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.834437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:1.0:1788463426.950243:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178854d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485793152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463426.950348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.950675:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793152 00000100:00100000:3.0:1788463426.950687:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793152 00000100:00100000:3.0:1788463426.950763:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788463426.950776:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485793152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463426.950823:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463426.951061:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485793152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.951076:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788463426.953074:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178854d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485793152:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463427.203993:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463427.780072:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463427.780089:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463427.780146:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788463427.780154:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463427.780354:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485793280:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463427.780527:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463427.783646:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485793280:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463427.786449:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463427.787419:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466838784 00000100:00100000:3.0:1788463427.787437:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466838784 00000100:00100000:3.0:1788463427.787543:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:3.0:1788463427.787558:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+22:11428:x1875339466838784:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463427.787641:0:12162:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463427.787828:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+22:11428:x1875339466838784:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 273us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463427.787837:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:3.0:1788463427.799338:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463427.801570:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466839040 00000100:00100000:2.0:1788463427.801632:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466839040 00000100:00100000:2.0:1788463427.801715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:2.0:1788463427.801728:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+22:11428:x1875339466839040:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463427.801753:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463427.801776:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768a3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463427.801891:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463427.801906:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463427.801922:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463427.801934:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463427.802047:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a0e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768a3 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463427.802080:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768a3 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463427.802089:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463427.802092:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463427.802095:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812c00, rc 0) 00000100:00100000:2.0:1788463427.802164:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+24:11428:x1875339466839040:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 439us (2841us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788463427.802183:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:3.0:1788463427.822700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463427.822914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466839296 00000100:00100000:0.0:1788463427.822928:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466839296 00000100:00100000:0.0:1788463427.823000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 144 00000100:00100000:0.0:1788463427.823013:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+24:11428:x1875339466839296:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788463427.823162:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823202:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823431:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823441:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823449:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823457:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463427.823463:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823472:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823491:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:0.0:1788463427.823495:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463427.823501:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463427.823507:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463427.824153:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+25:11428:x1875339466839296:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 1131us (1455us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788463427.824166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 144 00000040:00080000:1.0:1788463427.829353:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463427.829452:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463427.830173:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788463427.830188:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463427.834080:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463427.834175:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466839424 00000100:00100000:3.0:1788463427.834201:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466839424 00000100:00100000:3.0:1788463427.834290:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:3.0:1788463427.834303:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+25:2400:x1875339466839424:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463427.834323:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463427.834355:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768a3 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463427.834392:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:3.0:1788463427.834409:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463427.834489:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+24:2400:x1875339466839424:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 188us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463427.834497:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:0.0:1788463427.849284:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463427.849416:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466839680 00000100:00100000:1.0:1788463427.849449:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466839680 00000100:00100000:1.0:1788463427.849531:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:1.0:1788463427.849544:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+24:11428:x1875339466839680:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788463427.849904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+25:11428:x1875339466839680:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 361us (633us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788463427.849913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000040:00080000:3.0:1788463427.938295:0:14275:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463427.938307:0:14275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463427.938354:0:14275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788463427.938445:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788463428.036335:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463428.195043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463428.197255:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466839936 00000100:00100000:0.0:1788463428.197278:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466839936 00000100:00100000:0.0:1788463428.197401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:0.0:1788463428.197415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+25:11441:x1875339466839936:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463428.197448:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463428.197477:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768aa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788463428.197723:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463428.198742:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a105 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.198903:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a105 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.198920:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a105 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463428.198940:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463428.200198:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a0fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768aa expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463428.200235:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a105 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768aa expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463428.200247:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463428.200250:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463428.200255:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1e00, rc 0) 00000100:00100000:2.0:1788463428.200383:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+27:11441:x1875339466839936:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2967us (5352us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788463428.200404:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:3.0:1788463428.205218:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463428.205820:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840064 00000100:00100000:1.0:1788463428.205837:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840064 00000100:00100000:1.0:1788463428.205968:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 146 00000100:00100000:1.0:1788463428.205983:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+27:11441:x1875339466840064:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463428.206095:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206118:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206133:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206182:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206191:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206199:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206206:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0ca00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463428.206229:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206238:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206254:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:1.0:1788463428.206258:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463428.206265:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.206272:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0ca00/0x841acb7f42a3a113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463428.206388:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+27:11441:x1875339466840064:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 408us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463428.206406:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 146 00010000:00010000:0.0:1788463428.228000:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463428.343350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463428.346704:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840192 00000100:00100000:1.0:1788463428.346729:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840192 00000100:00080000:2.0:1788463428.353706:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463428.353964:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:1.0:1788463428.353996:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466840192:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:1.0:1788463428.354022:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463428.354052:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bccc8d6/0x841acb7f42a3a11a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768b1 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463428.354085:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a99c941, atime: 0x6a99c941, ctime: 0x6a99c941, blocks: 0x8 00010000:00010000:1.0:1788463428.354112:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788463428.354118:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463428.354130:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bccc8d6/0x841acb7f42a3a11a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.354175:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bccc8d6/0x841acb7f42a3a11a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463428.354193:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ca00, rc 0) 00000100:00100000:1.0:1788463428.354276:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466840192:12345-192.168.204.53@tcp:101:cat.0 Request processed in 300us (10943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463428.354284:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:2.0:1788463428.359144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463428.369105:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840320 00000100:00100000:0.0:1788463428.369132:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840320 00002000:00100000:0.0:1788463428.369244:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff96188553f100 x1875339466840320/t0(0) o3->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:564/0 lens 488/0 e 0 to 0 dl 1788463439 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463428.369257:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188553f100 with x1875339466840320 ext(0->4095) 00002000:00010000:0.0:1788463428.369265:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188553f100 00000100:00100000:0.0:1788463428.369359:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:0.0:1788463428.369372:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2403:x1875339466840320:12345-192.168.204.53@tcp:3:cat.0 00000100:00100000:0.0:1788463428.369707:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2403:x1875339466840320:12345-192.168.204.53@tcp:3:cat.0 Request processed in 337us (10577us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788463428.369716:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00002000:00100000:0.0:1788463428.369724:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff96188553f100 x1875339466840320/t0(0) o3->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:564/0 lens 488/4536 e 0 to 0 dl 1788463439 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463428.369733:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188553f100 with x1875339466840320 ext(0->4095) 00002000:00010000:0.0:1788463428.369736:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188553f100 00000100:00100000:3.0:1788463428.852221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463428.852272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463428.852314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463428.852360:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463428.852375:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840576 00000100:00100000:2.0:1788463428.852385:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840832 00000100:00100000:2.0:1788463428.852400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840832 00000100:00100000:1.0:1788463428.852400:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840576 00000100:00100000:3.0:1788463428.852407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463428.852488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840960 00000100:00100000:1.0:1788463428.852492:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840960 00000100:00100000:0.0:1788463428.852504:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840448 00000100:00100000:3.0:1788463428.852549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 343 00000100:00100000:3.0:1788463428.852565:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466840576:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463428.852709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466840576:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 149us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463428.852718:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 343 00000100:00100000:0.0:1788463428.852829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840448 00000100:00100000:0.0:1788463428.852870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 394 00000100:00100000:0.0:1788463428.852878:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466840448:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463428.852909:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466840448:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463428.852916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 394 00000100:00100000:0.0:1788463428.852974:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466840704 00000100:00100000:0.0:1788463428.852979:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466840704 00000100:00100000:1.0:1788463428.862499:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 344 00000100:00100000:1.0:1788463428.862521:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466840960:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463428.862654:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466840960:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 138us (10247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463428.862662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 344 00000100:00100000:2.0:1788463428.863241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 345 00000100:00100000:2.0:1788463428.863256:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466840832:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463428.863305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466840832:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 55us (11032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463428.863313:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 345 00000100:00100000:0.0:1788463428.863513:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:0.0:1788463428.863524:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466840704:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463428.863597:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466840704:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 76us (11250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463428.863605:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00080000:3.0:1788463428.869005:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463428.869022:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463428.869027:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788463428.871419:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463428.871431:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463428.871456:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788463428.871469:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788463429.265488:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463429.507923:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463429.507955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485793408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463429.508051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463429.508134:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793408 00000100:00100000:1.0:1788463429.508144:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793408 00000100:00100000:1.0:1788463429.508539:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463429.508551:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485793408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463429.508612:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463429.508761:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485793408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 212us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463429.508768:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788463429.508795:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463429.508972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485793408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463430.020369:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463430.020403:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485793536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463430.020506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463430.022256:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793536 00000100:00100000:1.0:1788463430.022275:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793536 00000100:00100000:1.0:1788463430.022387:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788463430.022401:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485793536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463430.022437:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463430.022540:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485793536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463430.022549:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788463430.022657:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463430.022721:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485793536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463430.278527:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463431.043919:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463431.044024:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463431.044059:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463431.044076:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485793792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463431.044109:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463431.044157:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793664 00000100:00100000:0.0:1788463431.044157:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793792 00000100:00100000:2.0:1788463431.044167:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793664 00000100:00100000:0.0:1788463431.044167:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793792 00000100:00100000:1.0:1788463431.044328:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463431.044349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485793920:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.044390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.044456:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485794304:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.044486:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.044517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794304 00000100:00100000:1.0:1788463431.044521:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794304 00000100:00100000:1.0:1788463431.044596:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788463431.044606:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485794304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.044665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485794304:12345-0@lo:400:kworker.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.044684:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788463431.044799:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788463431.044806:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485793792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463431.044836:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463431.044872:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485793792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463431.044878:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788463431.044914:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485794304:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.044970:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463431.044978:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485794432:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.045009:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.045037:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794432 00000100:00100000:1.0:1788463431.045042:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794432 00000100:00100000:1.0:1788463431.045069:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788463431.045075:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485794432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.045113:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485794432:12345-0@lo:400:kworker.0 Request processed in 37us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.045119:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788463431.045144:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485794432:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.045189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485794816:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.045216:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.045248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794816 00000100:00100000:1.0:1788463431.045252:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794816 00000100:00100000:3.0:1788463431.045322:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485793920 00000100:00100000:3.0:1788463431.045327:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485793920 00000100:00100000:3.0:1788463431.045375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788463431.045382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.045422:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485793920:12345-0@lo:400:kworker.0 Request processed in 41us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463431.045428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788463431.045464:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485794048:0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.045494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.045513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485794560:0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.045533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.045552:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463431.045557:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485794176:0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.045609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.045628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485794688:0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.045648:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.045675:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794048 00000100:00100000:3.0:1788463431.045679:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794048 00000100:00100000:3.0:1788463431.045703:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794560 00000100:00100000:3.0:1788463431.045706:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794560 00000100:00100000:2.0:1788463431.047688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794688 00000100:00100000:2.0:1788463431.047707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794688 00000100:00100000:2.0:1788463431.047786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788463431.047811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.047942:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485794048:12345-0@lo:400:kworker.0 Request processed in 133us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.047950:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788463431.047971:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788463431.047978:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048008:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485794688:12345-0@lo:400:kworker.0 Request processed in 31us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.048013:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00080000:2.0:1788463431.048064:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e1b100 x1875339485794688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463431.048080:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485794688:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048096:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485794048:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048182:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794176 00000100:00100000:2.0:1788463431.048188:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794176 00000100:00100000:2.0:1788463431.048218:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788463431.048224:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048266:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485794176:12345-0@lo:400:kworker.0 Request processed in 42us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.048273:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788463431.048320:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485793792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463431.048388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485794176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048420:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485793920:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048485:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788463431.048494:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485793664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463431.048511:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463431.048549:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485793664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (4526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.048556:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788463431.048614:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463431.048700:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485794944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048741:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463431.048780:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485794944 00000100:00100000:2.0:1788463431.048784:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485794944 00000100:00100000:2.0:1788463431.048819:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788463431.048827:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875339485794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048859:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875339485794944:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.048865:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788463431.048888:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485794944:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048928:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485795072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.048955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463431.048982:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795072 00000100:00100000:2.0:1788463431.048986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795072 00000100:00100000:2.0:1788463431.049014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788463431.049030:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.049062:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485795072:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.049067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788463431.049093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485795072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.049126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485795200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.049956:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463431.050012:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795200 00000100:00100000:2.0:1788463431.050019:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795200 00000100:00100000:2.0:1788463431.050070:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788463431.050080:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485795200:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788463431.050284:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463431.050311:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463431.050315:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463431.050318:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463431.050788:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485795200:12345-0@lo:400:kworker.0 Request processed in 705us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.050807:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788463431.050900:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788463431.050915:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485794816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.050972:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485794816:12345-0@lo:400:kworker.0 Request processed in 64us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.050977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788463431.051031:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485794816:0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.052195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788463431.052211:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485794560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463431.052304:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485794560:12345-0@lo:400:kworker.0 Request processed in 99us (6769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463431.052332:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788463431.052404:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485794560:0@lo:400:kworker.0 00010000:00080000:0.0:1788463431.055663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188553f480 x1875339485795200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463431.055688:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485795200:0@lo:400:kworker.0 00010000:00010000:3.0:1788463431.309873:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463431.556333:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485795328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463431.556454:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.556545:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795328 00000100:00100000:3.0:1788463431.556556:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795328 00000100:00100000:3.0:1788463431.556639:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788463431.556649:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189153d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485795328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463431.556699:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788463431.556754:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189153d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485795328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463431.556761:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788463431.558547:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485795328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463432.070893:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485795456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463432.071002:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463432.071198:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795456 00000100:00100000:2.0:1788463432.071210:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795456 00000100:00100000:2.0:1788463432.071281:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788463432.071292:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485795456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463432.071351:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463432.071422:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485795456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463432.071429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788463432.071541:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485795456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463432.334191:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788463432.583877:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788463432.583894:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1788463432.587111:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788463432.587148:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96188fb77f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788463432.587154:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96178708c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96188fb77cc0 00000020:00080000:1.0:1788463432.587164:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96178708c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96188cff4400 00000020:00080000:1.0:1788463432.587186:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788463432.587200:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788463432.587282:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788463432.590847:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590887:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590895:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590902:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463432.590907:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590915:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590934:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff961884f9df00) 00010000:00010000:2.0:1788463432.590938:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463432.590943:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463432.590949:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a095 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463432.593036:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1788463433.348562:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463433.989385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989498:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463433.989613:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841344 00000100:00100000:1.0:1788463433.989625:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841344 00000100:00100000:1.0:1788463433.989701:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841856 00000100:00100000:1.0:1788463433.989704:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841856 00000100:00100000:1.0:1788463433.989722:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841216 00000100:00100000:1.0:1788463433.989725:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841216 00000100:00100000:1.0:1788463433.989738:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841728 00000100:00100000:1.0:1788463433.989741:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841728 00000100:00100000:1.0:1788463433.989759:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 352 00000100:00100000:1.0:1788463433.989770:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466841344:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.989870:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466841344:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.989878:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 352 00000100:00100000:1.0:1788463433.989899:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 353 00000100:00100000:1.0:1788463433.989906:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466841856:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.989933:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466841856:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.989949:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 353 00000100:00100000:1.0:1788463433.989962:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 354 00000100:00100000:1.0:1788463433.989969:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+13:2403:x1875339466841216:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.989997:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+13:2403:x1875339466841216:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.990003:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 354 00000100:00100000:1.0:1788463433.990014:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 355 00000100:00100000:1.0:1788463433.990020:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466841728:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.990040:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466841728:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.990046:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 355 00000100:00100000:1.0:1788463433.990062:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841600 00000100:00100000:1.0:1788463433.990065:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841600 00000100:00100000:1.0:1788463433.990088:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841472 00000100:00100000:1.0:1788463433.990090:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841472 00000100:00100000:1.0:1788463433.990494:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:1.0:1788463433.990502:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466841600:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.990530:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466841600:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.990536:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:1.0:1788463433.990546:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:1.0:1788463433.990551:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466841472:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463433.990570:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466841472:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 18us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463433.990598:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00080000:1.0:1788463433.990625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463433.990630:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463433.990633:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463433.990635:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463433.994013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841088 00000100:00100000:0.0:1788463433.994034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841088 00000100:00100000:0.0:1788463433.994129:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 396 00000100:00100000:0.0:1788463433.994142:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466841088:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463433.994930:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466841088:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 784us (5555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463433.994941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 396 00010000:00010000:3.0:1788463434.371841:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463434.628400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485795584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463434.628508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463434.628638:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795584 00000100:00100000:1.0:1788463434.628647:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795584 00000100:00100000:1.0:1788463434.628722:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788463434.628746:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485795584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463434.628795:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463434.628848:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485795584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463434.628855:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788463434.628877:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463434.628922:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485795584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463435.140252:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463435.140339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463435.140513:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795712 00000100:00100000:0.0:1788463435.140522:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795712 00000100:00080000:2.0:1788463435.140604:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463435.140622:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788463435.140644:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485795712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463435.140669:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788463435.140717:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485795712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463435.140724:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788463435.141606:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788463435.141948:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96178854c700, transno 4294967311 00000004:00080000:1.0:1788463435.141971:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788463435.142006:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463435.157005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463435.158610:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466841984 00000100:00100000:2.0:1788463435.158693:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466841984 00000100:00100000:2.0:1788463435.158858:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:2.0:1788463435.158874:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+13:11102:x1875339466841984:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788463435.158976:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463435.159356:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+13:11102:x1875339466841984:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 487us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463435.159364:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:0.0:1788463435.178692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463435.179023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842112 00000100:00100000:1.0:1788463435.179034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842112 00000100:00100000:1.0:1788463435.179175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:1.0:1788463435.179186:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:11102:x1875339466842112:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788463435.179308:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:11102:x1875339466842112:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 124us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463435.179317:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00080000:2.0:1788463435.180000:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463435.187078:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463435.187221:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842368 00000100:00100000:0.0:1788463435.187232:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842368 00000100:00100000:0.0:1788463435.187301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:0.0:1788463435.187311:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+13:11102:x1875339466842368:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463435.187607:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+14:11102:x1875339466842368:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 262us (504us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788463435.187617:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00010000:00010000:1.0:1788463435.396281:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463435.492351:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463435.492537:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842496 00000100:00100000:0.0:1788463435.492550:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842496 00000100:00100000:0.0:1788463435.492673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00100000:0.0:1788463435.492684:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:11901:x1875339466842496:12345-192.168.204.53@tcp:101:lsof.0 00010000:00010000:0.0:1788463435.492710:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463435.492737:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a3a121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768b8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.492810:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.492824:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.492847:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463435.492899:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463435.492904:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463435.492945:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.492971:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0000/0x841acb7f42a3a121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.492990:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463435.493013:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463435.493016:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463435.493020:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0c00, rc 0) 00000100:00100000:0.0:1788463435.493089:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:11901:x1875339466842496:12345-192.168.204.53@tcp:101:lsof.0 Request processed in 407us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463435.493096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00080000:2.0:1788463435.493796:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463436.164191:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485796736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164353:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164376:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485797248:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164396:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788463436.164427:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485796096:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164453:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164473:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485796608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164495:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164510:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485797120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164545:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485797632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463436.164625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796096 00000100:00100000:1.0:1788463436.164645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796096 00000100:00100000:1.0:1788463436.164689:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788463436.164698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485796096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485796096:12345-0@lo:400:kworker.0 Request processed in 52us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.164755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788463436.164791:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796608 00000100:00100000:1.0:1788463436.164795:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796608 00000100:00100000:1.0:1788463436.164817:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788463436.164823:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485796608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164854:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485796608:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.164860:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788463436.164877:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797120 00000100:00100000:1.0:1788463436.164880:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797120 00000100:00100000:1.0:1788463436.164903:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797632 00000100:00100000:1.0:1788463436.164906:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797632 00000100:00100000:1.0:1788463436.164929:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463436.164935:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485797120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.164965:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485797120:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.164972:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788463436.164983:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463436.164989:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485797632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165013:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485797632:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.165019:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788463436.165052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796224 00000100:00100000:1.0:1788463436.165056:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796224 00000100:00100000:1.0:1788463436.165078:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796736 00000100:00100000:1.0:1788463436.165081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796736 00000100:00100000:1.0:1788463436.165099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797248 00000100:00100000:1.0:1788463436.165100:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797248 00000100:00100000:1.0:1788463436.165115:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788463436.165120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165150:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485796224:12345-0@lo:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.165156:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788463436.165167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788463436.165173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485796736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165199:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485796736:12345-0@lo:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.165204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788463436.165214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788463436.165219:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485797248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165257:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875339485797248:12345-0@lo:400:kworker.0 Request processed in 38us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463436.165262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788463436.165298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485796096:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485796608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165319:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485797120:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165326:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788463436.165331:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961882fa3b80, transno 4294967305 00000100:00100000:1.0:1788463436.165348:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485797632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165362:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485796736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463436.165380:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3649:1875339485797248:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166049:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485795840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463436.166097:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485796352:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166156:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166176:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485796864:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166212:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166228:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485797376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166266:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166284:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788463436.166291:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485795968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463436.166312:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166329:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617878d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485796480:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166359:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485796992:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166379:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166397:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485797504:0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166415:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.166445:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796352 00000100:00100000:3.0:1788463436.166451:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796352 00000100:00100000:3.0:1788463436.166484:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788463436.166491:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463436.166530:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485796352:12345-0@lo:400:kworker.0 Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463436.166537:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788463436.166554:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796992 00000100:00100000:3.0:1788463436.166557:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796992 00000100:00080000:2.0:1788463436.166899:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463436.166905:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463436.166908:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463436.166918:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796864 00000100:00100000:2.0:1788463436.166921:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796864 00000100:00100000:2.0:1788463436.166961:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797376 00000100:00100000:2.0:1788463436.166964:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797376 00000100:00100000:2.0:1788463436.166975:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485796480 00000100:00100000:2.0:1788463436.166977:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485796480 00000100:00100000:2.0:1788463436.167001:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788463436.167007:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485796864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167044:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485796864:12345-0@lo:400:kworker.0 Request processed in 38us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.167050:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788463436.167062:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788463436.167068:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485797376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167093:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485797376:12345-0@lo:400:kworker.0 Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.167098:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788463436.167107:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788463436.167113:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485796480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167137:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485796480:12345-0@lo:400:kworker.0 Request processed in 24us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.167142:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:2.0:1788463436.167154:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463436.167182:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797504 00000100:00100000:2.0:1788463436.167194:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797504 00000100:00100000:2.0:1788463436.167220:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788463436.167227:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485796992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167271:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485796992:12345-0@lo:400:kworker.0 Request processed in 45us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.167277:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788463436.167288:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788463436.167294:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167320:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485797504:12345-0@lo:400:kworker.0 Request processed in 27us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.167326:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788463436.167339:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463436.167380:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485796480:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167391:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485796992:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167400:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485797504:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.167411:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485796352:0@lo:400:kworker.0 00010000:00080000:2.0:1788463436.167424:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617878d3100 x1875339485796864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463436.167433:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617878d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485796864:0@lo:400:kworker.0 00010000:00080000:2.0:1788463436.167440:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fa1a300 x1875339485797376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463436.167448:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485797376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463436.167653:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795840 00000100:00100000:0.0:1788463436.167658:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795840 00000100:00100000:0.0:1788463436.167696:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485795968 00000100:00100000:0.0:1788463436.167700:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485795968 00000100:00100000:0.0:1788463436.167714:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463436.167721:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485795840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463436.167745:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463436.167786:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485795840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463436.167792:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463436.167804:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788463436.167810:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485795968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463436.167819:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463436.167840:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485795968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463436.167845:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788463436.167871:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485795968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463436.167883:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485795840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788463436.419938:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463436.676041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463436.676074:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485797760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463436.676178:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463436.676438:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797760 00000100:00100000:3.0:1788463436.676451:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797760 00000100:00100000:2.0:1788463436.676621:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788463436.676655:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485797760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463436.676704:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788463436.676776:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485797760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.676783:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788463436.677152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617869d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485797760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463437.193642:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485797888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463437.193760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463437.194475:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485797888 00000100:00100000:2.0:1788463437.194488:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485797888 00000100:00100000:2.0:1788463437.194613:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788463437.194625:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485797888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463437.194678:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463437.194868:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485797888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 244us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463437.194877:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788463437.194982:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485797888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463437.445794:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463438.084361:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463438.084372:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463438.084517:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788463438.084525:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788463438.090271:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788463438.090285:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788463438.090351:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788463438.090363:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1788463438.276309:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463438.467991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463439.092036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463439.092271:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842880 00000100:00100000:2.0:1788463439.092282:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842880 00000100:00100000:2.0:1788463439.092339:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843392 00000100:00100000:2.0:1788463439.092342:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843392 00000100:00100000:2.0:1788463439.092357:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842752 00000100:00100000:2.0:1788463439.092360:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842752 00000100:00100000:2.0:1788463439.092371:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843264 00000100:00100000:2.0:1788463439.092373:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843264 00000100:00100000:2.0:1788463439.092406:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 362 00000100:00100000:2.0:1788463439.092415:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466842880:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092515:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466842880:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 101us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092524:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 362 00000100:00100000:2.0:1788463439.092543:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 363 00000100:00100000:2.0:1788463439.092551:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466843392:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092618:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466843392:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 69us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092626:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 363 00000100:00100000:2.0:1788463439.092639:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 364 00000100:00100000:2.0:1788463439.092647:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+13:2402:x1875339466842752:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092678:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+13:2402:x1875339466842752:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092685:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 364 00000100:00100000:2.0:1788463439.092696:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 365 00000100:00100000:2.0:1788463439.092702:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466843264:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092731:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466843264:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092738:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 365 00000100:00100000:2.0:1788463439.092761:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843136 00000100:00100000:2.0:1788463439.092765:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843136 00000100:00100000:2.0:1788463439.092791:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843008 00000100:00100000:2.0:1788463439.092794:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843008 00000100:00100000:2.0:1788463439.092825:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:2.0:1788463439.092832:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466843136:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466843136:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092868:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:2.0:1788463439.092880:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:2.0:1788463439.092886:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466843008:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463439.092908:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466843008:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.092914:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00080000:2.0:1788463439.092930:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463439.092934:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463439.092936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788463439.092938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463439.093395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466842624 00000100:00100000:0.0:1788463439.093401:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466842624 00000100:00100000:0.0:1788463439.093442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 398 00000100:00100000:0.0:1788463439.093449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466842624:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463439.093692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466842624:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 54us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.093700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 398 00010000:00010000:3.0:1788463439.491859:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463439.747870:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485798016:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463439.747948:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463439.748135:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798016 00000100:00100000:1.0:1788463439.748144:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798016 00000100:00100000:1.0:1788463439.748226:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463439.748239:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617869d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485798016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463439.748271:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463439.748323:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617869d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485798016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463439.748330:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463439.748377:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485798016:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788463439.748442:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463440.260229:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463440.260254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485798144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463440.260326:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463440.260515:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798144 00000100:00100000:3.0:1788463440.260523:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798144 00000100:00100000:3.0:1788463440.260648:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788463440.260660:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485798144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463440.260683:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788463440.260740:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485798144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463440.260747:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788463440.260890:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485798144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463440.260953:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463440.519107:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463441.283912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463441.283941:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485798272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463441.284036:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.284166:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798272 00000100:00100000:0.0:1788463441.284176:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798272 00000100:00100000:0.0:1788463441.284250:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463441.284262:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485798272:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463441.284281:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485798400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463441.284327:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788463441.284328:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463441.284373:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798400 00000100:00100000:1.0:1788463441.284377:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798400 00000100:00100000:0.0:1788463441.284378:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485798272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.284387:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463441.284407:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463441.284412:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485798400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463441.284710:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463441.284743:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485798400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 330us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463441.284820:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485798400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463441.286406:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788463441.286662:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463441.286821:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485798272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463441.286853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485798656:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.286899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485798784:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.286922:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.286935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.286969:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485799296:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.286991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.287013:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485799808:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287035:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.287035:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.287058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.287067:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798784 00000100:00100000:3.0:1788463441.287074:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798784 00000100:00100000:0.0:1788463441.287077:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.287097:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.287128:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798656 00000100:00100000:0.0:1788463441.287132:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798656 00000100:00100000:3.0:1788463441.287150:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788463441.287159:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485798784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.287167:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799296 00000100:00100000:0.0:1788463441.287170:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799296 00000100:00100000:0.0:1788463441.287190:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799808 00000100:00100000:0.0:1788463441.287193:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799808 00000100:00100000:0.0:1788463441.287209:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799168 00000100:00100000:0.0:1788463441.287212:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799168 00000100:00100000:3.0:1788463441.287214:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485798784:12345-0@lo:400:kworker.0 Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.287221:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788463441.287224:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799680 00000100:00100000:3.0:1788463441.287264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788463441.287272:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485798656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287309:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485798656:12345-0@lo:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.287316:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788463441.287331:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788463441.287337:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485799296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287364:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485799296:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.287369:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788463441.287380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788463441.287386:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485799808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.287401:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799680 00000100:00100000:3.0:1788463441.287410:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485799808:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.287415:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788463441.287425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788463441.287430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485799168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287456:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485799168:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.287461:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788463441.287480:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485798912:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287520:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.287538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485799424:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287564:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.287638:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798912 00000100:00100000:0.0:1788463441.287641:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798912 00000100:00100000:0.0:1788463441.287656:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788463441.287662:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485799680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.287693:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788463441.287693:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485799680:12345-0@lo:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.287700:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788463441.287706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485798528:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.287711:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788463441.287716:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.291208:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485798912:12345-0@lo:400:kworker.0 Request processed in 3478us (3674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.292109:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:0.0:1788463441.292181:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463441.292188:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463441.292263:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485799168:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.292283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485799680:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.292299:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485798656:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.294912:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.295006:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485799040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.295100:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.295414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485799552:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.295448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.295504:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485798912:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.295567:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799424 00000100:00100000:3.0:1788463441.295603:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799424 00000100:00100000:1.0:1788463441.295998:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799040 00000100:00100000:1.0:1788463441.296004:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799040 00000100:00100000:1.0:1788463441.296049:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788463441.296060:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485799040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.296161:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485799040:12345-0@lo:400:kworker.0 Request processed in 102us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463441.296169:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788463441.296206:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485799040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.296399:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799552 00000100:00100000:3.0:1788463441.296405:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799552 00000100:00100000:1.0:1788463441.296451:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788463441.296461:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485799424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.296507:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485799424:12345-0@lo:400:kworker.0 Request processed in 49us (8942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463441.296514:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788463441.296528:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788463441.296536:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485799552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.296569:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485799552:12345-0@lo:400:kworker.0 Request processed in 33us (1119us total) trans 0 rc 0/0 00000100:00080000:0.0:1788463441.296597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463441.296818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485798528 00000100:00100000:2.0:1788463441.296824:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485798528 00000100:00100000:2.0:1788463441.296862:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788463441.296869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463441.296908:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485798528:12345-0@lo:400:kworker.0 Request processed in 40us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463441.296915:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788463441.297275:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788463441.297390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485798528:0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.297405:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485799552:0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.297418:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485799424:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.297639:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485798784:0@lo:400:kworker.0 00010000:00080000:3.0:1788463441.297658:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fae3480 x1875339485799296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463441.297740:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485799296:0@lo:400:kworker.0 00010000:00080000:3.0:1788463441.297759:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787daea00 x1875339485799808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463441.297768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787daea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485799808:0@lo:400:kworker.0 00010000:00010000:1.0:1788463441.541627:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463441.695045:0:14473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:24:00 (1788463440) 00000100:00100000:0.0:1788463441.797569:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463441.797634:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485799936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463441.797735:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.798314:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485799936 00000100:00100000:3.0:1788463441.798327:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485799936 00000100:00100000:3.0:1788463441.798410:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788463441.798433:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485799936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463441.798485:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788463441.798570:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485799936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.798892:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485799936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463441.799353:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788463442.308418:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463442.308454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485800064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463442.308564:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463442.310860:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800064 00000100:00100000:1.0:1788463442.310885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800064 00000100:00100000:1.0:1788463442.311005:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788463442.311041:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485800064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463442.311099:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463442.311226:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485800064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 188us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463442.311234:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788463442.311485:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485800064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463442.565407:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463443.590962:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463443.780969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463443.781107:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843648 00000100:00100000:1.0:1788463443.781122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843648 00000100:00100000:1.0:1788463443.781229:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:1.0:1788463443.781243:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+13:12170:x1875339466843648:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463443.781272:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463443.781302:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a12f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768bf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781402:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781434:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781448:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781474:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781482:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781490:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781692:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a144 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781701:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781709:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463443.781721:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788463443.781836:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781844:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781852:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781859:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0de00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463443.781865:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781874:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781889:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961894655700) 00010000:00010000:1.0:1788463443.781893:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463443.781898:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781918:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a136 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781936:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781943:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781949:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781953:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463443.781957:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781963:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781972:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961787b68200) 00010000:00010000:1.0:1788463443.781974:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463443.781977:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.781983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a13d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463443.783423:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463443.787398:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a12f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768bf expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.787455:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a144 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768bf expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463443.787487:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:1.0:1788463443.787491:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463443.787495:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463443.787625:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+15:12170:x1875339466843648:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 6384us (6671us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788463443.787644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:2.0:1788463443.794752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463443.795244:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463443.796232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843776 00000100:00100000:1.0:1788463443.796250:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843776 00000100:00100000:1.0:1788463443.796360:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:1.0:1788463443.796383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+15:12170:x1875339466843776:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788463443.796554:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+15:12170:x1875339466843776:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 181us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463443.796563:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:3.0:1788463443.801486:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466843904 00000100:00100000:3.0:1788463443.801512:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466843904 00000100:00100000:3.0:1788463443.806226:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:3.0:1788463443.806262:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+15:2400:x1875339466843904:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463443.806291:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463443.806328:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a144 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768bf expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463443.806358:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:3.0:1788463443.806365:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463443.808282:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+14:2400:x1875339466843904:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 2024us (13021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463443.808299:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:2.0:1788463443.817294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463443.818106:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844032 00000100:00100000:3.0:1788463443.818123:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844032 00000100:00100000:3.0:1788463443.818225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:3.0:1788463443.818240:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:12170:x1875339466844032:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788463443.818418:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463443.818666:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+5:12170:x1875339466844032:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 429us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463443.818676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:3.0:1788463444.206949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.207007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.207033:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.207068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.207150:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844672 00000100:00100000:3.0:1788463444.207176:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844672 00000100:00100000:3.0:1788463444.207274:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:3.0:1788463444.207291:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466844672:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463444.207465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844160 00000100:00100000:1.0:1788463444.207470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844160 00000100:00100000:1.0:1788463444.207510:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 400 00000100:00100000:1.0:1788463444.207517:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466844160:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463444.207636:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466844672:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 348us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463444.207646:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:3.0:1788463444.207676:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844416 00000100:00100000:3.0:1788463444.207680:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844416 00000100:00100000:3.0:1788463444.207711:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844928 00000100:00100000:3.0:1788463444.207714:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844928 00000100:00100000:3.0:1788463444.207739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 372 00000100:00100000:3.0:1788463444.207746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466844416:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463444.208704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2403:x1875339466844160:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1182us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463444.208712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 400 00000100:00100000:1.0:1788463444.208758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 373 00000100:00100000:1.0:1788463444.208768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466844928:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463444.208795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2403:x1875339466844928:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463444.208816:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 373 00000100:00100000:3.0:1788463444.208902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2403:x1875339466844416:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 1156us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463444.208910:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 372 00000100:00080000:3.0:1788463444.208931:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463444.208936:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463444.221970:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.222114:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463444.222780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463444.222893:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844544 00000100:00100000:2.0:1788463444.222911:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844544 00000100:00100000:2.0:1788463444.223020:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:2.0:1788463444.223033:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466844544:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463444.223151:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466844544:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 120us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463444.223160:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00080000:2.0:1788463444.227363:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788463444.228141:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463444.228149:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463444.228739:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788463444.228754:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463444.234158:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844288 00000100:00100000:0.0:1788463444.234278:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844288 00000100:00100000:1.0:1788463444.235287:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466844800 00000100:00100000:1.0:1788463444.235297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466844800 00000100:00100000:1.0:1788463444.235548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 374 00000100:00100000:1.0:1788463444.235565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466844800:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463444.235818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466844800:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 253us (13037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463444.235830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 374 00000100:00100000:1.0:1788463444.235921:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 375 00000100:00100000:1.0:1788463444.235933:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+14:2402:x1875339466844288:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463444.235977:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+14:2402:x1875339466844288:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 45us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463444.235986:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 375 00000100:00080000:2.0:1788463444.240169:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788463444.422636:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463444.626489:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463444.871282:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485800192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463444.871397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463444.871901:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800192 00000100:00100000:1.0:1788463444.871913:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800192 00000100:00100000:1.0:1788463444.871999:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463444.872010:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485800192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463444.872050:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463444.872125:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485800192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463444.872134:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463444.872213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485800192:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788463444.873030:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463445.380882:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463445.380922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485800320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463445.381049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463445.381171:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800320 00000100:00100000:1.0:1788463445.381182:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800320 00000100:00100000:1.0:1788463445.381280:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788463445.381297:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485800320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463445.381333:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463445.381401:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485800320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463445.381411:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788463445.381444:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463445.381504:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485800320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463445.638179:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463446.406717:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485800448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463446.406837:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.407104:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800448 00000100:00100000:0.0:1788463446.407115:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800448 00000100:00100000:0.0:1788463446.407198:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788463446.407211:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485800448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463446.407252:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463446.407313:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485800448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.407321:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788463446.407387:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463446.407402:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485800576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463446.407447:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463446.407544:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800576 00000100:00100000:1.0:1788463446.407550:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800576 00000100:00100000:1.0:1788463446.407622:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788463446.407630:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485800576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463446.407642:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463446.407678:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485800576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463446.407684:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1788463446.407749:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463446.407897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485800704:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.407957:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.408436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800704 00000100:00100000:0.0:1788463446.408443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800704 00000100:00100000:0.0:1788463446.408503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788463446.408513:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485800704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.408601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485800704:12345-0@lo:400:kworker.0 Request processed in 62us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.408608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1788463446.408666:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485800704:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.414984:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463446.418987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485800960:0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.419125:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.419230:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618843f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485800448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463446.419263:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463446.419270:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485801088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.419299:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.419383:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800960 00000100:00100000:0.0:1788463446.419392:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800960 00000100:00100000:0.0:1788463446.419459:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788463446.419470:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485800960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.419547:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485800960:12345-0@lo:400:kworker.0 Request processed in 78us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.419555:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788463446.419616:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485800960:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.420270:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801088 00000100:00100000:3.0:1788463446.420282:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801088 00000100:00100000:3.0:1788463446.420347:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788463446.420356:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485801088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.420416:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485801088:12345-0@lo:400:kworker.0 Request processed in 61us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463446.420423:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788463446.420454:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485801216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.420485:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485800576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463446.420518:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463446.420545:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.420555:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801216 00000100:00100000:3.0:1788463446.420558:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801216 00000100:00100000:3.0:1788463446.420603:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788463446.420611:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485801216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.420644:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485801216:12345-0@lo:400:kworker.0 Request processed in 35us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463446.420651:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788463446.420861:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463446.420894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485801216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.421247:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485800832 00000100:00100000:3.0:1788463446.421257:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485800832 00000100:00100000:3.0:1788463446.421324:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788463446.421333:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485800832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.421385:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485800832:12345-0@lo:400:kworker.0 Request processed in 53us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463446.421392:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788463446.421474:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485801088:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.421924:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.422211:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485801344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.422261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463446.422335:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801344 00000100:00100000:1.0:1788463446.422340:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801344 00000100:00100000:1.0:1788463446.422394:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788463446.422404:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485801344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.422534:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485801472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.422565:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.422609:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463446.422615:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485801600:0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.422643:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463446.422672:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463446.427945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485801344:12345-0@lo:400:kworker.0 Request processed in 5526us (5666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463446.427963:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788463446.428003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801472 00000100:00100000:1.0:1788463446.428016:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801472 00000100:00100000:1.0:1788463446.428120:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788463446.428132:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485801472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.428232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485801472:12345-0@lo:400:kworker.0 Request processed in 103us (5666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463446.428240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00080000:1.0:1788463446.428313:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788405c00 x1875339485801472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463446.428331:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485801472:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.428385:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485801728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.428444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463446.429820:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463446.431198:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485801984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.431289:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463446.431527:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801984 00000100:00100000:2.0:1788463446.431537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801984 00000100:00100000:2.0:1788463446.431654:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788463446.431666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485801984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463446.432142:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485801984:12345-0@lo:400:kworker.0 Request processed in 476us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463446.432151:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00080000:2.0:1788463446.432210:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788443800 x1875339485801984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463446.432225:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485801984:0@lo:400:kworker.0 00000100:00080000:0.0:1788463446.432887:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463446.432956:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463446.432974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485801856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463446.433053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.433153:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801856 00000100:00100000:0.0:1788463446.433161:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801856 00000100:00100000:0.0:1788463446.433233:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788463446.433244:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485801856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.433297:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485801856:12345-0@lo:400:kworker.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.433303:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788463446.433524:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485801856:0@lo:400:kworker.0 00000100:00080000:1.0:1788463446.433547:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463446.435937:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801600 00000100:00100000:0.0:1788463446.435963:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801600 00000100:00100000:2.0:1788463446.436091:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485801728 00000100:00100000:2.0:1788463446.436097:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485801728 00000100:00100000:2.0:1788463446.436172:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788463446.436185:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463446.436311:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618843e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485801728:12345-0@lo:400:kworker.0 Request processed in 129us (7866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463446.436320:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788463446.437130:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788463446.437144:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485801600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463446.437223:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485801600:12345-0@lo:400:kworker.0 Request processed in 83us (14578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.437231:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788463446.437295:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485801600:0@lo:400:kworker.0 00000100:00100000:3.0:1788463446.439218:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485801344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463446.442105:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485801728:0@lo:400:kworker.0 00000100:00080000:1.0:1788463446.447865:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463446.661363:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463446.916996:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463446.917021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485802112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463446.917106:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463446.917177:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485802112 00000100:00100000:0.0:1788463446.917184:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485802112 00000100:00100000:0.0:1788463446.917231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788463446.917240:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485802112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463446.917274:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788463446.917320:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485802112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463446.917327:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788463446.917387:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485802112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463446.971019:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463446.971124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845056 00000100:00100000:1.0:1788463446.971135:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845056 00000100:00100000:1.0:1788463446.971216:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:1.0:1788463446.971227:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+14:12213:x1875339466845056:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463446.971248:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463446.971270:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768c6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971350:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971364:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971376:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971390:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971404:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971411:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971466:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971473:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971480:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971486:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463446.971490:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971498:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971509:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:1.0:1788463446.971513:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463446.971518:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971525:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971537:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971542:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971548:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971559:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463446.971561:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971568:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971603:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961787b68200) 00010000:00010000:1.0:1788463446.971606:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463446.971609:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.971615:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a160 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463446.971965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463446.972868:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a152 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768c6 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.972885:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:1.0:1788463446.972889:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463446.972894:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768c6 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463446.972908:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0dc00, rc 0) 00000100:00100000:1.0:1788463446.972986:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+14:12213:x1875339466845056:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1761us (1979us total) trans 0 rc 301/301 00000100:00100000:1.0:1788463446.972996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:1.0:1788463446.983914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463446.984034:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845312 00000100:00100000:0.0:1788463446.984045:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845312 00000100:00100000:0.0:1788463446.984105:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:0.0:1788463446.984116:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+14:12213:x1875339466845312:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:0.0:1788463446.984181:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463446.984208:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a39aa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766ea expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.984231:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463446.984237:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463446.984295:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.984308:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.984317:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.984362:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 5 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.984376:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 5 pid: 6523 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463446.984390:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485802240:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463446.984489:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463446.991001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463446.993281:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845440 00000100:00100000:2.0:1788463446.993296:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845440 00010000:00010000:2.0:1788463446.993378:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 6 pid: 6523 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463446.993437:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00100000:2.0:1788463446.993447:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2400:x1875339466845440:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463446.993465:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463446.993473:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 6 pid: 6523 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463446.993509:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 6 pid: 6523 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463446.993534:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463446.993540:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463446.993551:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463446.993560:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463446.993622:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463446.993688:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2400:x1875339466845440:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 243us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463446.993697:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00080000:3.0:1788463446.994037:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463446.996146:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b8 expref: 5 pid: 6523 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463446.996173:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485802240:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463446.996200:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.996225:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.996231:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.996261:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.996275:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.996286:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997190:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997205:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997213:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463446.997231:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008023a529 reply state 000000003363be0e transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997243:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997252:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463446.997261:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463446.997266:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788463446.997272:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788463446.997281:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997286:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997292:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997297:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463446.997301:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997308:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997319:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463446.997322:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463446.997326:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997333:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a167 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463446.997350:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008023a529 reply state 000000003363be0e transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997359:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463446.997375:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961787b9a600) 00010000:00010000:0.0:1788463446.997377:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463446.997379:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788463446.997483:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+15:12213:x1875339466845312:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 13366us (13576us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788463446.997493:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:3.0:1788463447.172155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.172339:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845568 00000100:00100000:0.0:1788463447.172350:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845568 00000100:00100000:0.0:1788463447.172416:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:0.0:1788463447.172427:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+15:12221:x1875339466845568:12345-192.168.204.53@tcp:101:lctl.0 00010000:00010000:0.0:1788463447.172457:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463447.172487:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a17c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768cd expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172570:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172606:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172618:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463447.172668:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463447.172672:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463447.172695:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172720:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a17c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768cd expref: 17 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172751:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768cd expref: 16 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.172760:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:0.0:1788463447.172763:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463447.172766:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0c00, rc 0) 00000100:00100000:0.0:1788463447.173142:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+16:12221:x1875339466845568:12345-192.168.204.53@tcp:101:lctl.0 Request processed in 714us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.173150:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:2.0:1788463447.250615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.250716:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845696 00000100:00100000:1.0:1788463447.250728:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845696 00000100:00100000:2.0:1788463447.250922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 156 00000100:00100000:2.0:1788463447.250939:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+16:12227:x1875339466845696:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463447.250964:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463447.251001:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a18a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768d4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251076:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251092:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251120:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251133:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251140:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251146:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251228:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251237:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251244:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463447.251280:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788463447.251285:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463447.251307:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251490:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251497:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251516:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251522:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463447.251527:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251535:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251548:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:2.0:1788463447.251552:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463447.251556:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251563:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251604:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251611:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251617:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251622:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463447.251625:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251641:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961787b9a600) 00010000:00010000:2.0:1788463447.251653:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463447.251656:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251661:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a198 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251693:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a18a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768d4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251708:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768d4 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.251715:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463447.251717:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463447.251720:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812c00, rc 0) 00000100:00100000:2.0:1788463447.251794:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+17:12227:x1875339466845696:12345-192.168.204.53@tcp:101:bash.0 Request processed in 862us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.251802:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 156 00000100:00100000:1.0:1788463447.254691:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.254802:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466845952 00000100:00100000:0.0:1788463447.254813:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466845952 00000100:00100000:0.0:1788463447.254872:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 157 00000100:00100000:0.0:1788463447.254882:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+17:12227:x1875339466845952:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463447.254903:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463447.254924:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a1a6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768db expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255051:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255067:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255078:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255094:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255118:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255125:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788463447.255461:0:10067:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788463447.255640:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255651:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255660:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255697:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255705:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255712:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255718:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463447.255722:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255729:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255753:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463447.255756:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463447.255761:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255768:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a1ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463447.255781:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5eb8c1d reply state 00000000d03a1a88 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255792:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255799:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a500) 00010000:00010000:0.0:1788463447.255801:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463447.255804:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788463447.255836:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a1a6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 20 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255851:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 19 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.255859:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:0.0:1788463447.255861:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463447.255864:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0400, rc 0) 00000100:00100000:0.0:1788463447.255943:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+20:12227:x1875339466845952:12345-192.168.204.53@tcp:101:bash.0 Request processed in 1062us (1260us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788463447.255952:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 157 00000100:00100000:3.0:1788463447.260148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.260251:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466846080 00000100:00100000:2.0:1788463447.260267:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466846080 00000100:00100000:2.0:1788463447.260365:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:2.0:1788463447.260379:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466846080:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463447.260412:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463447.260433:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768e2 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463447.260462:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463447.260482:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=486s v=(0 0) 00010000:00010000:2.0:1788463447.260487:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463447.260496:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 6 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.260527:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 6 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.260541:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:2.0:1788463447.260634:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2400:x1875339466846080:12345-192.168.204.53@tcp:101:bash.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.260642:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00080000:3.0:1788463447.260938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463447.263958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.264090:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466846208 00000100:00100000:0.0:1788463447.264114:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466846208 00000100:00100000:0.0:1788463447.264195:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:0.0:1788463447.264208:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+6:12227:x1875339466846208:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463447.264233:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463447.264269:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768e9 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.264321:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.264332:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463447.264337:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463447.264343:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.264391:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.264408:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463447.264425:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875339485802368:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463447.264835:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463447.268432:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8439:1875339485802368:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463447.268496:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.268550:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0800, rc 0) 00000100:00100000:0.0:1788463447.268736:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:12227:x1875339466846208:12345-192.168.204.53@tcp:101:bash.0 Request processed in 4528us (4791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.268746:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:1.0:1788463447.270345:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.271427:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466846336 00000100:00100000:0.0:1788463447.271445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466846336 00010000:00010000:0.0:1788463447.271522:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463447.271601:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 82 00000100:00100000:0.0:1788463447.271613:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466846336:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463447.271641:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463447.271674:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.271690:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.271720:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3a1c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e2 expref: 7 pid: 9857 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.271745:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463447.271750:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463447.271760:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.271792:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.271846:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463447.271865:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875339485802496:192.168.204.53@tcp:105: 00000100:00100000:0.0:1788463447.271989:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463447.276530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.276909:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875339485802496:192.168.204.53@tcp:105: 00010000:00010000:1.0:1788463447.276945:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463447.277046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466846336:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 5432us (6710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.277060:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 82 00000100:00100000:3.0:1788463447.277482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466846592 00000100:00100000:3.0:1788463447.277491:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466846592 00000100:00100000:3.0:1788463447.277546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:3.0:1788463447.277556:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+20:12227:x1875339466846592:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:3.0:1788463447.277966:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+21:12227:x1875339466846592:12345-192.168.204.53@tcp:35:bash.0 Request processed in 409us (1451us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788463447.277974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:0.0:1788463447.381284:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463447.381667:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466846848 00000100:00100000:3.0:1788463447.381681:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466846848 00000100:00100000:3.0:1788463447.381812:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 158 00000100:00100000:3.0:1788463447.381826:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+21:12237:x1875339466846848:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463447.381863:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463447.381892:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768f0 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463447.382044:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788463447.382197:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a1d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768f0 expref: 23 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.382224:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:3.0:1788463447.382227:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463447.382234:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768f0 expref: 23 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.382279:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdee00, rc 0) 00000100:00100000:3.0:1788463447.382371:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+22:12237:x1875339466846848:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 548us (1103us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788463447.382389:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 158 00000100:00100000:1.0:1788463447.390245:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463447.390336:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466847104 00000100:00100000:3.0:1788463447.390350:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466847104 00000100:00100000:3.0:1788463447.390440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:3.0:1788463447.390452:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+22:12237:x1875339466847104:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463447.391053:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+23:12237:x1875339466847104:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 600us (822us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788463447.391063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:3.0:1788463447.428876:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463447.428909:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485802624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463447.429011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463447.429514:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485802624 00000100:00100000:0.0:1788463447.429529:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485802624 00000100:00100000:0.0:1788463447.429653:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788463447.429667:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485802624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463447.429729:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788463447.429828:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485802624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.429836:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788463447.430083:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485802624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463447.534656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.534762:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466847232 00000100:00100000:2.0:1788463447.534778:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466847232 00000100:00100000:2.0:1788463447.534853:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 159 00000100:00100000:2.0:1788463447.534865:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+23:12243:x1875339466847232:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463447.534900:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463447.534928:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a1e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768f7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535041:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535090:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535105:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463447.535340:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788463447.535345:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463447.535373:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a1e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768f7 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535556:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768f7 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.535566:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463447.535570:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463447.535650:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813c00, rc 0) 00000100:00100000:2.0:1788463447.535740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+24:12243:x1875339466847232:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 876us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.535748:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 159 00000100:00100000:0.0:1788463447.542281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.547807:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466847488 00000100:00100000:2.0:1788463447.547832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466847488 00000100:00100000:2.0:1788463447.548545:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 160 00000100:00100000:2.0:1788463447.548564:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+24:12243:x1875339466847488:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463447.548617:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463447.548675:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a1f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4768fe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.548821:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a1fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.548837:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.548851:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a1fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463447.548863:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788463447.549031:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a1f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768fe expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.549060:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a1fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768fe expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.549083:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:2.0:1788463447.552370:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463447.552439:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:2.0:1788463447.552592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+26:12243:x1875339466847488:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 4009us (10308us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788463447.552603:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 160 00000100:00100000:3.0:1788463447.558214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463447.558264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.558453:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466847744 00000100:00100000:0.0:1788463447.558467:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466847744 00000100:00100000:1.0:1788463447.558479:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466847872 00000100:00100000:1.0:1788463447.558484:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466847872 00000100:00100000:0.0:1788463447.558624:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 161 00000100:00100000:0.0:1788463447.558638:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+27:12243:x1875339466847744:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463447.558667:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463447.558714:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a208 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476905 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.558860:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.558879:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.558895:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463447.558920:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788463447.559065:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a208 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476905 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.559089:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476905 expref: 29 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.559098:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:0.0:1788463447.559102:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788463447.559106:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1200, rc 0) 00000100:00100000:0.0:1788463447.559193:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+29:12243:x1875339466847744:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 558us (995us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788463447.559200:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 161 00000100:00100000:1.0:1788463447.560279:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463447.560301:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+28:2401:x1875339466847872:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463447.560320:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463447.560347:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a1fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768fe expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.560368:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:1.0:1788463447.560374:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463447.560429:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+27:2401:x1875339466847872:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 139us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.560437:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:0.0:1788463447.579124:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.579621:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848000 00000100:00100000:2.0:1788463447.579633:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848000 00000100:00100000:2.0:1788463447.579718:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:2.0:1788463447.579732:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+6:2401:x1875339466848000:12345-192.168.204.53@tcp:1:lfs.0 00010000:00010000:2.0:1788463447.579817:0:9857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.579844:0:9857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.579855:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788463447.579861:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463447.579867:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.579914:0:9857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.579932:0:9857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 6 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463447.579950:0:9857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9857:1875339485802752:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463447.580097:0:9857:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882e69900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463447.585228:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.585413:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848128 00000100:00100000:0.0:1788463447.585427:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848128 00002000:00100000:0.0:1788463447.585501:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff961788405c00 x1875339466848128/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:583/0 lens 504/0 e 0 to 0 dl 1788463458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463447.585538:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961788405c00 with x1875339466848128 ext(0->12) 00010000:00010000:0.0:1788463447.585551:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 7 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.585571:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 7 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463447.585626:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff961788405c00 00000100:00100000:0.0:1788463447.585676:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463447.585688:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466848128:12345-192.168.204.53@tcp:4:lfs.0 00000100:00100000:2.0:1788463447.587370:0:9857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9857:1875339485802752:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463447.587424:0:9857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463447.588284:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466848128:12345-192.168.204.53@tcp:4:lfs.0 Request processed in 2591us (3065us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788463447.588298:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00002000:00100000:0.0:1788463447.589010:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff961788405c00 x1875339466848128/t4294967306(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:583/0 lens 504/448 e 0 to 0 dl 1788463458 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463447.589032:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961788405c00 with x1875339466848128 ext(0->12) 00010000:00010000:0.0:1788463447.589045:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463447.589062:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463447.589071:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff961788405c00 00000100:00100000:3.0:1788463447.590924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.591250:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848256 00000100:00100000:1.0:1788463447.591277:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848256 00010000:00010000:1.0:1788463447.591341:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463447.591517:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:1.0:1788463447.591531:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2403:x1875339466848256:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463447.591551:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788463447.591623:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788463447.591627:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788463447 00002000:00010000:1.0:1788463447.591630:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788463448 00002000:00010000:1.0:1788463447.591639:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788463447 00002000:00010000:1.0:1788463447.591642:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788463447.591651:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.591667:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.591702:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a1d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768e9 expref: 9 pid: 8439 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.591907:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463447.591914:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463447.591923:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.591934:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.592083:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463447.592299:0:9857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592463:0:9857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592495:0:9857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592505:0:9857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592515:0:9857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592523:0:9857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463447.592529:0:9857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592540:0:9857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592555:0:9857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.592563:0:9857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006903212/0x841acb7f42a3a21d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463447.593079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2403:x1875339466848256:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 1545us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.593090:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 83 00000100:00100000:2.0:1788463447.593933:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466848000:12345-192.168.204.53@tcp:1:lfs.0 Request processed in 14196us (14815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.594531:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:1.0:1788463447.607536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463447.613523:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848512 00000100:00100000:0.0:1788463447.614244:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848512 00000100:00100000:0.0:1788463447.615295:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:0.0:1788463447.615457:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+27:12243:x1875339466848512:12345-192.168.204.53@tcp:35:lfs.0 00000004:00010000:0.0:1788463447.615552:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476905 expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463447.619105:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788463447.619285:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788463447.621545:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788463447.621665:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.621703:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 31 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.621714:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.623289:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 31 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.623483:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 31 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463447.623506:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485802880:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463447.624455:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463447.631226:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485802880:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463447.631290:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463447.631510:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.631625:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848640 00000100:00100000:2.0:1788463447.631635:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848640 00010000:00010000:2.0:1788463447.631688:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 32 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463447.631807:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 84 00000100:00100000:2.0:1788463447.631820:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+32:2400:x1875339466848640:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463447.631847:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463447.631857:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 32 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631872:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 32 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631901:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a1bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768db expref: 32 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631920:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:2.0:1788463447.631927:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631938:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631959:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.631984:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463447.632072:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+31:2400:x1875339466848640:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 252us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.632080:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 84 00010000:00010000:1.0:1788463447.632210:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.632218:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463447.636701:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788463447.637689:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788463447.638665:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485803008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788463447.639248:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463447.639500:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463447.644144:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485803008 00000100:00100000:0.0:1788463447.644169:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485803008 00000100:00100000:0.0:1788463447.644767:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788463447.644785:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485803008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788463447.644984:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485803008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (5737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.644992:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788463447.645101:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485803008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788463447.645349:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788463447.645468:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485803136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788463447.645519:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463447.659844:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485803136 00000100:00100000:2.0:1788463447.659868:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485803136 00000100:00100000:1.0:1788463447.660000:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463447.664704:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788463447.664753:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875339485803136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788463447.665077:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1875339485803136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 357us (19556us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788463447.665096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788463447.665653:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485803136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788463447.665761:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788463447.665823:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665835:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665845:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665852:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463447.665875:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665885:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665907:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:1.0:1788463447.665911:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788463447.665916:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.665922:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a224 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463447.666074:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788463447.666165:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1788463447.666190:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487117602589ns, next at 488117599629ns, rc = 0 00000001:00080000:1.0:1788463447.666199:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788463447.666235:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b9ab00) 00010000:00010000:1.0:1788463447.666239:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788463447.666248:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a20f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476905 expref: 35 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463447.666885:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+34:12243:x1875339466848512:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 51437us (59358us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788463447.666899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000020:00080000:1.0:1788463447.666907:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788463447.682248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.683916:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466848768 00000100:00100000:1.0:1788463447.683939:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466848768 00010000:00010000:0.0:1788463447.684167:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463447.684249:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 162 00000100:00100000:1.0:1788463447.684263:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+34:12243:x1875339466848768:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463447.686856:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463447.686912:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a22b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47690c expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.687006:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a22b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47690c expref: 35 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.690732:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a22b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47690c expref: 35 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.690785:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463447.690788:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463447.690792:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:1.0:1788463447.690889:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:12243:x1875339466848768:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 6627us (8656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.690899:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 162 00000100:00100000:1.0:1788463447.703704:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463447.704420:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466849024 00000100:00100000:3.0:1788463447.704435:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466849024 00000100:00100000:3.0:1788463447.704525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:3.0:1788463447.704538:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+35:12243:x1875339466849024:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463447.704901:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+36:12243:x1875339466849024:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 364us (1210us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788463447.704932:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:0.0:1788463447.866706:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463447.866871:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466849280 00000100:00100000:2.0:1788463447.866885:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466849280 00000100:00100000:2.0:1788463447.866970:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 163 00000100:00100000:2.0:1788463447.867004:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+36:12253:x1875339466849280:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463447.867047:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463447.867074:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476913 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463447.867215:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788463447.867352:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a232 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476913 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.867689:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:2.0:1788463447.867713:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463447.867722:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476913 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463447.867743:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:2.0:1788463447.867839:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+37:12253:x1875339466849280:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 858us (1148us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788463447.867847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 163 00000100:00100000:0.0:1788463447.870884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463447.870984:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466849408 00000100:00100000:3.0:1788463447.871015:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466849408 00000100:00100000:3.0:1788463447.871084:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 164 00000100:00100000:3.0:1788463447.871096:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+37:12253:x1875339466849408:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:3.0:1788463447.871201:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.871223:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.871238:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.871250:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.871258:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.871265:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.872183:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.872203:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.872214:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463447.873189:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873214:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873223:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873232:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873239:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdee00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463447.873245:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873254:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873272:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463447.873276:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463447.873282:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873289:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a240 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873833:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873843:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873867:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873873:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463447.873877:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873884:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873894:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a500) 00010000:00010000:3.0:1788463447.873897:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463447.873900:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873906:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a247 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873918:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873925:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873932:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873938:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463447.873941:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873958:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873967:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:3.0:1788463447.873970:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463447.873973:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463447.873978:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a24e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463447.875508:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+37:12253:x1875339466849408:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 4396us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463447.875527:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 164 00000100:00100000:3.0:1788463447.879967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.883276:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466849664 00000100:00100000:1.0:1788463447.883309:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466849664 00000100:00100000:1.0:1788463447.883412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:1.0:1788463447.883426:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+37:12253:x1875339466849664:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:1.0:1788463447.885745:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+38:12253:x1875339466849664:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 2306us (5777us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788463447.885761:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:0.0:1788463447.954626:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.954837:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466849920 00000100:00100000:1.0:1788463447.954851:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466849920 00000100:00100000:1.0:1788463447.954944:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 165 00000100:00100000:1.0:1788463447.954976:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+38:12256:x1875339466849920:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463447.955029:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463447.955059:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a255 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47691a expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955161:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955181:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955196:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955208:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955216:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955223:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955804:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955819:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955828:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463447.955853:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788463447.955957:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955967:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955975:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955983:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463447.955989:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.955999:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956183:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:1.0:1788463447.956187:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463447.956192:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956199:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a25c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956215:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956221:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956237:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956242:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463447.956245:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956251:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956258:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a500) 00010000:00010000:1.0:1788463447.956260:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463447.956264:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956269:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956317:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a255 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 41 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956332:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 40 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.956339:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463447.956341:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463447.956343:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463447.957555:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+40:12256:x1875339466849920:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2566us (2964us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788463447.957619:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 165 00000100:00100000:0.0:1788463447.965532:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.965693:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466850048 00000100:00100000:1.0:1788463447.965708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466850048 00000100:00100000:1.0:1788463447.965775:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 166 00000100:00100000:1.0:1788463447.965787:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+40:12256:x1875339466850048:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463447.965878:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965899:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965913:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965960:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965968:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965976:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965982:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463447.965987:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.965996:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.966020:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463447.966043:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463447.966050:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463447.966057:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463447.966141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+40:12256:x1875339466850048:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 356us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.966149:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 166 00000100:00100000:0.0:1788463447.973811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463447.973972:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466850304 00000100:00100000:1.0:1788463447.973986:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466850304 00000100:00100000:1.0:1788463447.974077:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:1.0:1788463447.974090:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+40:12256:x1875339466850304:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:1.0:1788463447.974418:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+41:12256:x1875339466850304:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 329us (626us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788463447.974427:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 41 00000040:00080000:0.0:1788463448.324046:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463448.324060:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463448.325898:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788463448.325935:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463448.346446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463448.346556:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466850560 00000100:00100000:3.0:1788463448.346570:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466850560 00000100:00100000:3.0:1788463448.346707:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00100000:3.0:1788463448.346723:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+41:12287:x1875339466850560:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:3.0:1788463448.346756:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463448.346784:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a27f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476921 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.346930:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.346948:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.346985:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463448.347011:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788463448.347159:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a27f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476921 expref: 44 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.347183:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476921 expref: 43 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.347192:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:3.0:1788463448.347195:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463448.347200:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf200, rc 0) 00000100:00100000:3.0:1788463448.347358:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+43:12287:x1875339466850560:12345-192.168.204.53@tcp:101:cat.0 Request processed in 640us (926us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788463448.347366:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00080000:0.0:1788463448.350554:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463448.367662:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463448.367802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463448.368249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466850944 00000100:00100000:3.0:1788463448.368263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466850944 00000100:00100000:3.0:1788463448.368342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:3.0:1788463448.368355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+43:12287:x1875339466850944:12345-192.168.204.53@tcp:35:cat.0 00000100:00100000:3.0:1788463448.368750:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+44:12287:x1875339466850944:12345-192.168.204.53@tcp:35:cat.0 Request processed in 396us (945us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788463448.368760:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:1.0:1788463448.370467:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466850688 00000100:00100000:1.0:1788463448.370486:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466850688 00000100:00100000:1.0:1788463448.370619:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:1.0:1788463448.370632:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+44:2402:x1875339466850688:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463448.370651:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463448.370683:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476921 expref: 44 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.370710:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463448.370717:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463448.370781:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+43:2402:x1875339466850688:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 153us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463448.370809:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:0.0:1788463448.446761:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463448.446939:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466851200 00000100:00100000:1.0:1788463448.446955:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466851200 00000100:00100000:1.0:1788463448.447054:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 168 00000100:00100000:1.0:1788463448.447067:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+43:12293:x1875339466851200:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:1.0:1788463448.447101:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463448.447115:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463448.447153:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a1ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768f7 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447183:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:1.0:1788463448.447189:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463448.447209:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a294 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476928 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447361:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447378:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 43 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447389:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447433:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 43 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.447448:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 43 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463448.447486:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803264:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463448.447959:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463448.451904:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803264:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463448.451951:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463448.452748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463448.453896:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466851328 00000100:00100000:1.0:1788463448.453915:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466851328 00010000:00010000:1.0:1788463448.453977:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 44 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463448.454178:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 85 00000100:00100000:1.0:1788463448.454192:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+44:2401:x1875339466851328:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463448.454213:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463448.454221:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 44 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454235:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 44 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454263:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a26a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47691a expref: 44 pid: 10067 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454283:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463448.454289:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454327:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454336:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.454370:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463448.454453:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+43:2401:x1875339466851328:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 264us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463448.454461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 85 00010000:00010000:0.0:1788463448.456259:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.456279:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463448.456318:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788463448.456532:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a294 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 44 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.456558:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 43 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.456570:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:0.0:1788463448.456629:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788463448.456634:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:0.0:1788463448.457922:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+43:12293:x1875339466851200:12345-192.168.204.53@tcp:101:dd.0 Request processed in 10851us (11174us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788463448.457934:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 168 00000100:00100000:0.0:1788463448.463900:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463448.463992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466851456 00000100:00100000:2.0:1788463448.464065:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466851456 00000100:00100000:2.0:1788463448.464223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:2.0:1788463448.464237:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+43:12293:x1875339466851456:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:2.0:1788463448.464280:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463448.464315:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a2a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47692f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464369:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464389:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464405:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464611:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464849:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.464870:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463448.464873:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463448.464877:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:2.0:1788463448.465014:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+44:12293:x1875339466851456:12345-192.168.204.53@tcp:101:dd.0 Request processed in 779us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463448.465022:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:2.0:1788463448.475526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463448.475804:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466851712 00000100:00100000:1.0:1788463448.475818:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466851712 00000100:00100000:1.0:1788463448.475900:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 170 00000100:00100000:1.0:1788463448.475914:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+44:12293:x1875339466851712:12345-192.168.204.53@tcp:36:dd.0 00010000:00010000:1.0:1788463448.477102:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.477134:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.477150:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463448.477224:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788463448.477374:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000750973e reply state 00000000244cc84a transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.477389:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463448.477421:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463448.477424:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463448.477430:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463448.481027:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+47:12293:x1875339466851712:12345-192.168.204.53@tcp:36:dd.0 Request processed in 5086us (5546us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788463448.481044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 170 00000020:00080000:1.0:1788463448.481054:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788463448.516932:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463448.712452:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463448.845307:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463448.845430:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466851840 00000100:00100000:2.0:1788463448.845445:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466851840 00000100:00100000:2.0:1788463448.845533:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 171 00000100:00100000:2.0:1788463448.845547:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+47:12307:x1875339466851840:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:2.0:1788463448.845622:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463448.845651:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a2be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476936 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845773:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845792:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845809:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845824:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845830:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845846:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845951:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845963:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 48 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.845972:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.846028:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 48 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.846045:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 48 pid: 10067 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463448.846062:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803392:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463448.846421:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882e69c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463448.854935:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463448.855042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852096 00000100:00100000:3.0:1788463448.855076:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852096 00000100:00100000:3.0:1788463448.855155:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:3.0:1788463448.855167:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+49:6171:x1875339466852096:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788463448.855630:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+50:6171:x1875339466852096:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 464us (709us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788463448.855640:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:0.0:1788463448.855866:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788440700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803392:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463448.855906:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463448.864119:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:1.0:1788463448.864150:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788463448.864179:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961787c06000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788463448.864184:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961898aba800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961787c06540 00000020:00080000:1.0:1788463448.864187:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961898aba400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96178849c600 00010000:00010000:2.0:1788463448.864266:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463448.864270:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1788463448.864290:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864301:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864335:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463448.864343:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864354:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463448.864363:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788463448.864379:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff961787b9a600) 00010000:00010000:2.0:1788463448.864385:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463448.864392:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864399:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a16e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864432:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864438:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864444:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864461:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463448.864464:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864470:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864491:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463448.864494:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463448.864498:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864504:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a175 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864522:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864529:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864535:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864541:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463448.864544:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864550:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864558:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a500) 00010000:00010000:2.0:1788463448.864561:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463448.864563:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864570:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a1b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864688:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864696:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864702:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864707:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463448.864710:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864716:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864725:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463448.864727:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463448.864731:0:3634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864742:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.864748:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463448.864813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188f9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485803520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463448.864899:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463448.865276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463448.865463:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852224 00000100:00100000:3.0:1788463448.865471:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852224 00010000:00010000:3.0:1788463448.865510:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 19 pid: 10067 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463448.865542:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 86 00000100:00100000:3.0:1788463448.865551:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+19:2400:x1875339466852224:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463448.865565:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463448.865593:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 19 pid: 10067 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865609:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 19 pid: 10067 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865632:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a29b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476928 expref: 19 pid: 10067 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463448.865654:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485803520 00010000:00010000:3.0:1788463448.865655:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00000100:00100000:2.0:1788463448.865668:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485803520 00010000:00010000:3.0:1788463448.865678:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865691:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865699:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865737:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463448.865745:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463448.865762:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485803520:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463448.865808:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+18:2400:x1875339466852224:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 254us (530us total) trans 0 rc 0/0 00002000:00080000:2.0:1788463448.865811:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000100:00100000:3.0:1788463448.865823:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 86 00002000:00010000:2.0:1788463448.865858:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a99c957, atime: 0x6a99c958, ctime: 0x6a99c957, blocks: 0x8 00010000:00010000:2.0:1788463448.865867:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.865886:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788463448.865892:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463448.865899:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.865918:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.865928:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865933:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.865936:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.865951:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463448.866015:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788463448.866020:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463448.866042:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866056:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866068:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866075:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866094:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866100:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463448.866105:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866113:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866123:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463448.866126:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463448.866130:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866136:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813800/0x841acb7f42a3a2c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866149:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866154:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866160:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866165:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463448.866169:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866184:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866192:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a500) 00010000:00010000:3.0:1788463448.866194:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463448.866197:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866271:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3a2cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866375:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3a2be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476936 expref: 18 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866392:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476936 expref: 17 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463448.866400:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:3.0:1788463448.866403:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463448.866405:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:3.0:1788463448.866436:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+17:12307:x1875339466851840:12345-192.168.204.53@tcp:101:stat.0 Request processed in 20893us (21155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463448.866443:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 171 00000100:00080000:0.0:1788463448.867455:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788463448.869871:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463448.870035:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463448.870052:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.870068:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463448.870075:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.870088:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.870111:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.870121:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001836cae1/0x841acb7f42a3a2da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463448.870152:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463448.870166:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463448.870170:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463448.870182:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1875339485803520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4421us (5277us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788463448.870196:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:3.0:1788463448.870268:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96188f9e2680/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788463448.870288:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188f9e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485803520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463448.955363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463448.955517:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852480 00000100:00100000:2.0:1788463448.955528:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852480 00000100:00100000:2.0:1788463448.955630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 172 00000100:00100000:2.0:1788463448.955642:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+17:12313:x1875339466852480:12345-192.168.204.53@tcp:36:truncate.0 00010000:00010000:2.0:1788463448.955712:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463448.955740:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a2d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476936 expref: 17 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.955762:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463448.955767:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463448.955965:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.955981:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.956002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463448.956043:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788463448.956065:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006fcacb5 reply state 0000000093c42706 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.956077:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463448.956084:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463448.956087:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463448.956090:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463448.956176:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+19:12313:x1875339466852480:12345-192.168.204.53@tcp:36:truncate.0 Request processed in 536us (826us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788463448.956184:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 172 00000020:00080000:2.0:1788463448.956189:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788463449.198301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.198427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852608 00000100:00100000:1.0:1788463449.198437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852608 00000100:00100000:1.0:1788463449.198498:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 173 00000100:00100000:1.0:1788463449.198509:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+19:12327:x1875339466852608:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:1.0:1788463449.198535:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463449.198557:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a2e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47693d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198659:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198673:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198693:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198709:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198717:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198724:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198971:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.198993:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199001:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463449.199043:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788463449.199048:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463449.199071:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199083:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199092:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199109:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199116:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199121:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463449.199125:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199132:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199145:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:1.0:1788463449.199148:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463449.199153:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199159:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a2ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199172:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199178:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199183:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199188:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463449.199197:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199203:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199211:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9d600) 00010000:00010000:1.0:1788463449.199214:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463449.199217:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199223:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a2f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199254:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a2e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199267:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.199275:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463449.199278:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463449.199280:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463449.199420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+20:12327:x1875339466852608:12345-192.168.204.53@tcp:101:stat.0 Request processed in 912us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463449.199428:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 173 00000100:00100000:0.0:1788463449.330695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.330745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.330794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.330821:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.331030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466853248 00000100:00100000:0.0:1788463449.331041:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466853248 00000100:00100000:0.0:1788463449.331099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852864 00000100:00100000:0.0:1788463449.331103:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852864 00000100:00100000:0.0:1788463449.331145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 382 00000100:00100000:0.0:1788463449.331156:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466853248:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463449.331227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466853248:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 73us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463449.331234:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 382 00000100:00100000:0.0:1788463449.331251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 383 00000100:00100000:0.0:1788463449.331258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466852864:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463449.331281:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466852864:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463449.331288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 383 00000100:00080000:0.0:1788463449.331305:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463449.331309:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463449.331332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.331419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.331449:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466853376 00000100:00100000:0.0:1788463449.331453:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466853376 00000100:00080000:0.0:1788463449.331473:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463449.331501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 384 00000100:00100000:0.0:1788463449.331695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466853376:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463449.331726:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466853376:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 219us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463449.331732:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 384 00000100:00100000:2.0:1788463449.331977:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852992 00000100:00100000:2.0:1788463449.332003:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852992 00000100:00100000:2.0:1788463449.332053:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466853120 00000100:00100000:2.0:1788463449.332057:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466853120 00000100:00100000:2.0:1788463449.332082:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:2.0:1788463449.332091:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466852992:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463449.332125:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2402:x1875339466852992:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463449.332132:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:2.0:1788463449.332150:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:2.0:1788463449.332157:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178854ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466853120:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463449.332184:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178854ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466853120:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 28us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463449.332191:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00080000:2.0:1788463449.332205:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463449.332208:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463449.332367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466852736 00000100:00100000:1.0:1788463449.332372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466852736 00000100:00100000:1.0:1788463449.332409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 402 00000100:00100000:1.0:1788463449.332417:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466852736:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463449.332451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466852736:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463449.332460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 402 00000100:00100000:0.0:1788463449.372506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.372741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466853632 00000100:00100000:2.0:1788463449.372756:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466853632 00000100:00100000:2.0:1788463449.372838:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 174 00000100:00100000:2.0:1788463449.372850:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+20:12337:x1875339466853632:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463449.372877:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463449.372905:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476944 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463449.373053:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788463449.373197:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a304 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476944 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.373239:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:2.0:1788463449.373242:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463449.373249:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476944 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.373266:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21a00, rc 0) 00000100:00100000:2.0:1788463449.373499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+21:12337:x1875339466853632:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 650us (1008us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788463449.373507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 174 00000100:00100000:2.0:1788463449.377356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463449.377557:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466853888 00000100:00100000:3.0:1788463449.377571:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466853888 00000100:00100000:3.0:1788463449.377688:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463449.377702:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+21:12337:x1875339466853888:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463449.378013:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+22:12337:x1875339466853888:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 314us (674us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788463449.378022:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463449.498429:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.498631:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466854144 00000100:00100000:2.0:1788463449.498644:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466854144 00000100:00100000:2.0:1788463449.498731:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:2.0:1788463449.498744:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+22:12343:x1875339466854144:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463449.498774:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463449.498802:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a312 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47694b expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.498964:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.498994:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.499005:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.499072:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.499089:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 23 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463449.499106:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485803648:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463449.499274:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882e690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463449.504893:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463449.505920:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466854272 00000100:00100000:3.0:1788463449.505936:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466854272 00010000:00010000:3.0:1788463449.506026:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 24 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463449.506065:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 87 00000100:00100000:3.0:1788463449.506076:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+24:2401:x1875339466854272:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463449.506093:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463449.506100:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 24 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463449.506124:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 24 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463449.506153:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:3.0:1788463449.506160:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463449.506172:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463449.506201:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463449.506226:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463449.507066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+24:2401:x1875339466854272:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 986us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463449.507079:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 87 00010000:00010000:2.0:1788463449.507280:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a2fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47693d expref: 23 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463449.507317:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485803648:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463449.507364:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.507752:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.507761:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463449.507801:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788463449.508448:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a312 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 24 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.508472:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 23 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.508508:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463449.508511:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463449.508516:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463449.509210:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+23:12343:x1875339466854144:12345-192.168.204.53@tcp:101:bash.0 Request processed in 10395us (10724us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788463449.509223:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 175 00000100:00100000:0.0:1788463449.512395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.512698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466854528 00000100:00100000:1.0:1788463449.512713:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466854528 00000100:00100000:1.0:1788463449.512883:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 176 00000100:00100000:1.0:1788463449.512898:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+23:12343:x1875339466854528:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:1.0:1788463449.513282:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.513306:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.513320:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463449.513372:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1788463449.513394:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053620783 reply state 0000000074b92049 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.513408:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.513417:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463449.513420:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788463449.513425:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463449.513543:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+26:12343:x1875339466854528:12345-192.168.204.53@tcp:36:bash.0 Request processed in 648us (1163us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788463449.513551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 176 00000020:00080000:1.0:1788463449.513609:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788463449.520696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.521056:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466854656 00000100:00100000:2.0:1788463449.521073:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466854656 00000100:00100000:2.0:1788463449.521164:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 177 00000100:00100000:2.0:1788463449.521177:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+26:12343:x1875339466854656:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463449.521208:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463449.521234:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a32e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476952 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.521363:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.521381:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.521390:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.521441:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.521457:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 27 pid: 12162 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463449.521492:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803776:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463449.521653:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882e690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463449.526887:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788443b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485803776:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463449.526945:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463449.528457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.529018:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466854784 00000100:00100000:2.0:1788463449.529032:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466854784 00010000:00010000:2.0:1788463449.529091:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 28 pid: 12162 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463449.529148:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 88 00000100:00100000:2.0:1788463449.529161:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+28:2401:x1875339466854784:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463449.529181:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463449.529190:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 28 pid: 12162 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529205:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 28 pid: 12162 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529232:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a319 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47694b expref: 28 pid: 12162 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529254:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463449.529260:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529300:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529310:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.529355:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463449.529453:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+27:2401:x1875339466854784:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 293us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463449.529461:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 88 00010000:00010000:0.0:1788463449.529723:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.529741:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463449.529820:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788463449.529826:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463449.529853:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.529896:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a32e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476952 expref: 27 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.529915:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476952 expref: 26 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.529924:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:0.0:1788463449.529927:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463449.529929:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20400, rc 0) 00000100:00100000:0.0:1788463449.529965:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+26:12343:x1875339466854656:12345-192.168.204.53@tcp:101:bash.0 Request processed in 8791us (9288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463449.529973:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 177 00000100:00100000:3.0:1788463449.533711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.533840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466855040 00000100:00100000:1.0:1788463449.533854:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466855040 00000100:00100000:1.0:1788463449.533923:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:1.0:1788463449.533937:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+26:12343:x1875339466855040:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:1.0:1788463449.535016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188f9e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+27:12343:x1875339466855040:12345-192.168.204.53@tcp:35:bash.0 Request processed in 1072us (1310us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788463449.535028:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:1.0:1788463449.683524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.683704:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466855296 00000100:00100000:2.0:1788463449.683719:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466855296 00000100:00100000:2.0:1788463449.683811:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 178 00000100:00100000:2.0:1788463449.683824:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+27:12353:x1875339466855296:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463449.683856:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463449.683885:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476959 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463449.684044:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788463449.684494:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a33c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476959 expref: 29 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.684513:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:2.0:1788463449.684517:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463449.684524:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476959 expref: 29 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.684541:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463449.684778:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+28:12353:x1875339466855296:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 956us (1273us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1788463449.684788:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 178 00000100:00100000:3.0:1788463449.690834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.691027:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466855424 00000100:00100000:1.0:1788463449.691042:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466855424 00000100:00100000:1.0:1788463449.691241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 179 00000100:00100000:1.0:1788463449.691256:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+28:12353:x1875339466855424:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:1.0:1788463449.691370:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691394:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691412:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691433:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691441:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691448:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.691571:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692530:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692542:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463449.692633:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692760:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692768:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692776:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692783:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463449.692788:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692796:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692812:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:1.0:1788463449.692816:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463449.692822:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692848:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a34a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692867:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692874:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692880:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692886:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463449.692889:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692895:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692904:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9d600) 00010000:00010000:1.0:1788463449.692906:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463449.692909:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692915:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692935:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692942:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692954:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692960:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0dc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463449.692962:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.692969:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.698298:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463449.698305:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463449.698315:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.698325:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a358 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463449.698503:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+28:12353:x1875339466855424:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 7243us (8397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463449.698516:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 179 00000100:00100000:1.0:1788463449.717444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.717621:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466855680 00000100:00100000:2.0:1788463449.717633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466855680 00000100:00100000:2.0:1788463449.717725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:2.0:1788463449.717739:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+28:12353:x1875339466855680:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:2.0:1788463449.718066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+29:12353:x1875339466855680:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 330us (638us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788463449.718075:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00010000:00010000:0.0:1788463449.732613:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463449.775832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463449.776094:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466855936 00000100:00100000:0.0:1788463449.776118:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466855936 00000100:00100000:0.0:1788463449.776239:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 180 00000100:00100000:0.0:1788463449.776253:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+29:12356:x1875339466855936:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463449.776300:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463449.776329:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a35f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476960 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776481:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776500:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776781:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776803:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776811:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776819:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.776988:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a374 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777416:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777434:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463449.777449:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788463449.777768:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777794:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777800:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777806:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463449.777811:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777819:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777833:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463449.777836:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463449.777841:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777846:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777862:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777867:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777872:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777878:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463449.777887:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777893:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777901:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961787b9a000) 00010000:00010000:0.0:1788463449.777904:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463449.777907:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.777912:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a36d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.778182:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a35f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476960 expref: 32 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.778202:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476960 expref: 31 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463449.778209:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:0.0:1788463449.778212:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463449.778214:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1400, rc 0) 00000100:00100000:0.0:1788463449.778516:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+31:12356:x1875339466855936:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 2255us (2687us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788463449.778527:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 180 00000100:00100000:3.0:1788463449.786809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.787014:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466856064 00000100:00100000:1.0:1788463449.787026:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466856064 00000100:00100000:1.0:1788463449.787117:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:1.0:1788463449.787130:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+31:2402:x1875339466856064:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463449.787152:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463449.787186:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a374 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476960 expref: 31 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463449.787234:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463449.787241:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463449.787493:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+30:2402:x1875339466856064:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 364us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463449.787501:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:1.0:1788463449.795864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463449.796059:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466856192 00000100:00100000:2.0:1788463449.796073:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466856192 00000100:00100000:2.0:1788463449.796153:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 181 00000100:00100000:2.0:1788463449.796166:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+30:12356:x1875339466856192:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:2.0:1788463449.796270:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796293:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796308:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796754:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796764:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796794:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796801:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463449.796805:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796815:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796830:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463449.796833:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463449.796839:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463449.796846:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463449.796951:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+30:12356:x1875339466856192:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 786us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463449.796960:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 181 00000100:00100000:2.0:1788463449.808419:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463449.808852:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466856448 00000100:00100000:1.0:1788463449.808866:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466856448 00000100:00100000:1.0:1788463449.808943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:1.0:1788463449.808956:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+30:12356:x1875339466856448:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463449.811771:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+31:12356:x1875339466856448:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 2798us (3350us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788463449.811789:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:0.0:1788463449.990651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485803904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463449.990770:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463449.992610:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485803904 00000100:00100000:1.0:1788463449.992635:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485803904 00000100:00100000:1.0:1788463449.992762:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788463449.992776:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485803904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463449.992831:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463449.992941:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485803904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463449.992950:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788463449.993379:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463449.993654:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485803904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463450.023754:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.023881:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466856704 00000100:00100000:2.0:1788463450.023894:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466856704 00000100:00100000:2.0:1788463450.024000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 182 00000100:00100000:2.0:1788463450.024016:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+31:12374:x1875339466856704:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:2.0:1788463450.024049:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463450.024078:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476967 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463450.024464:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463450.024702:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a390 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.024721:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.024736:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463450.024750:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788463450.024898:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476967 expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.024922:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476967 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.024931:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.024935:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463450.024939:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463450.025089:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+33:12374:x1875339466856704:12345-192.168.204.53@tcp:101:cat.0 Request processed in 1079us (1351us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788463450.025099:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 182 00000100:00100000:2.0:1788463450.063482:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.063827:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466856832 00000100:00100000:0.0:1788463450.063843:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466856832 00000100:00100000:0.0:1788463450.063940:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 183 00000100:00100000:0.0:1788463450.063954:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+33:12375:x1875339466856832:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463450.064000:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463450.064030:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47696e expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064173:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064193:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064209:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463450.064281:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788463450.064297:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463450.064323:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064717:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47696e expref: 35 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064741:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47696e expref: 34 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.064762:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463450.064766:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463450.064770:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0e00, rc 0) 00000100:00100000:0.0:1788463450.064864:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+34:12375:x1875339466856832:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 912us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.064872:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 183 00000100:00100000:3.0:1788463450.070723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.071081:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857216 00000100:00100000:1.0:1788463450.071095:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857216 00000100:00100000:1.0:1788463450.071392:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:1.0:1788463450.071407:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+34:12375:x1875339466857216:12345-192.168.204.53@tcp:35:lfs.0 00000001:00080000:1.0:1788463450.071747:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:1.0:1788463450.071883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+36:12375:x1875339466857216:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 478us (1174us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788463450.071912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 48 00000020:00080000:1.0:1788463450.071919:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788463450.076561:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.076668:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857344 00000100:00100000:0.0:1788463450.076684:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857344 00000100:00100000:0.0:1788463450.076894:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:0.0:1788463450.076910:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+36:12375:x1875339466857344:12345-192.168.204.53@tcp:103:lfs.0 00010000:00010000:0.0:1788463450.076932:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788463450.076977:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476952 expref: 36 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.077007:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476967 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.077021:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a22b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47690c expref: 34 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.077033:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:0.0:1788463450.077039:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463450.077117:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+33:12375:x1875339466857344:12345-192.168.204.53@tcp:103:lfs.0 Request processed in 211us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.077126:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:2.0:1788463450.082550:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.083181:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857472 00000100:00100000:3.0:1788463450.083197:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857472 00000100:00100000:3.0:1788463450.083288:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 184 00000100:00100000:3.0:1788463450.083301:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+33:12375:x1875339466857472:12345-192.168.204.53@tcp:58:lfs.0 00010000:00010000:3.0:1788463450.083473:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.083511:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.083529:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463450.084006:0:12162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788463450.084157:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+33:12375:x1875339466857472:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 855us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.084168:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 184 00000100:00100000:3.0:1788463450.122093:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.122622:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857600 00000100:00100000:2.0:1788463450.122635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857600 00000100:00100000:2.0:1788463450.122722:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 185 00000100:00100000:2.0:1788463450.122735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+33:12377:x1875339466857600:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463450.122832:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463450.122864:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476975 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.122958:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.122987:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123002:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123020:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123028:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123035:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123146:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123157:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123164:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463450.123226:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788463450.123239:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463450.123701:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123718:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123728:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123735:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123742:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123748:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.123753:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.123983:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124001:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463450.124005:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.124010:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124018:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124036:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124056:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124063:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124068:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.124072:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124079:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124088:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961894655a00) 00010000:00010000:2.0:1788463450.124091:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.124094:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124101:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.124237:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.127727:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.127761:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.127765:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463450.127799:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20200, rc 0) 00000100:00100000:2.0:1788463450.127920:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+34:12377:x1875339466857600:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 5180us (5834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463450.127931:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 185 00000040:00080000:1.0:1788463450.373049:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463450.373063:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463450.373103:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788463450.373113:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463450.373300:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787eaa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485804032:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463450.373431:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463450.379166:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.379650:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857728 00000100:00100000:0.0:1788463450.379665:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857728 00000100:00100000:0.0:1788463450.379747:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:0.0:1788463450.379761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466857728:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463450.379808:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463450.379986:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466857728:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 228us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.379996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 186 00000100:00100000:1.0:1788463450.381921:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787eaa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485804032:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463450.400210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.400319:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466857856 00000100:00100000:2.0:1788463450.400334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466857856 00000100:00100000:2.0:1788463450.400420:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:2.0:1788463450.400432:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+34:12388:x1875339466857856:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788463450.400563:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.400615:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.400631:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.403846:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.403874:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.403889:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404145:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404189:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463450.404251:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788463450.404256:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463450.404271:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404286:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404292:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404299:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404305:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.404309:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404317:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404332:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463450.404336:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.404343:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404350:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a3cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404379:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404385:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404391:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404397:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.404400:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404406:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404415:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff961894655a00) 00010000:00010000:2.0:1788463450.404417:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.404421:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404426:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a3d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404448:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404454:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404460:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404473:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.404476:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404482:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404491:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.404493:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.404496:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.404501:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a3dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.404704:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+34:12388:x1875339466857856:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 4269us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463450.404714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 187 00000100:00100000:0.0:1788463450.414154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.414256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466858112 00000100:00100000:1.0:1788463450.414271:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466858112 00000100:00100000:1.0:1788463450.414350:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:1.0:1788463450.414363:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+34:12388:x1875339466858112:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463450.414395:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463450.414424:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a3e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47697c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414647:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414668:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414691:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463450.414711:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788463450.414858:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414874:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414882:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414887:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0de00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.414893:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414903:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414919:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463450.414923:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463450.414930:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414936:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a3eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.414999:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a3e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47697c expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.415011:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:1.0:1788463450.415014:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463450.415019:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3a3e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47697c expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.415042:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463450.415115:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858112:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 754us (974us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1788463450.415124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 188 00000100:00100000:2.0:1788463450.433121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.436902:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466858240 00000100:00100000:0.0:1788463450.436923:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466858240 00000100:00100000:0.0:1788463450.437335:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 189 00000100:00100000:0.0:1788463450.437349:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858240:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463450.437404:0:12162:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463450.437645:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858240:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 299us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.437654:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 189 00000100:00100000:1.0:1788463450.453068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.453206:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466858496 00000100:00100000:3.0:1788463450.453220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466858496 00000100:00100000:3.0:1788463450.453313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 190 00000100:00100000:3.0:1788463450.453326:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858496:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.453355:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463450.453359:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788463450.453396:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a3a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47696e expref: 35 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.453423:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463450.453430:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463450.453449:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a3f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476983 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463450.457467:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788463450.458453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a400 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.458480:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.458494:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.459737:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a3f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476983 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.459776:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476983 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.460233:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961885469f00) 00010000:00010000:3.0:1788463450.460238:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463450.460244:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:3.0:1788463450.460443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+36:12388:x1875339466858496:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 7116us (7387us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788463450.460454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 190 00000100:00100000:1.0:1788463450.466204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.466300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466858752 00000100:00100000:2.0:1788463450.466314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466858752 00000100:00100000:2.0:1788463450.466401:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 191 00000100:00100000:2.0:1788463450.466416:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+36:12388:x1875339466858752:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463450.466521:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463450.466561:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a400 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476983 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.466625:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961885469f00) 00010000:00010000:2.0:1788463450.466646:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463450.466679:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.466696:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.466709:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471012:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471040:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471055:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471113:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471121:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471128:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471134:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.471139:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471147:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471176:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463450.471179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.471184:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471191:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a40e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471218:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471224:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471230:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471234:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.471237:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471242:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471250:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbace14df (ffff961894655a00) 00010000:00010000:2.0:1788463450.471252:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.471255:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.471261:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a415 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbace14df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.471392:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858752:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 4975us (5200us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463450.471401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 191 00000100:00100000:3.0:1788463450.474105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.474376:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466858880 00000100:00100000:0.0:1788463450.474393:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466858880 00000100:00100000:0.0:1788463450.474525:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 192 00000100:00100000:0.0:1788463450.474539:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:12388:x1875339466858880:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463450.474569:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463450.474641:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a41c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47698a expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474694:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474724:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474740:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474896:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a41c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 37 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474918:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 36 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.474929:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:0.0:1788463450.474932:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463450.474936:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1200, rc 0) 00000100:00100000:0.0:1788463450.475033:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+36:12388:x1875339466858880:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 498us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.475041:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 192 00000100:00100000:0.0:1788463450.487701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.487862:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466859136 00000100:00100000:3.0:1788463450.487876:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466859136 00000100:00100000:3.0:1788463450.487970:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 193 00000100:00100000:3.0:1788463450.487984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+36:12388:x1875339466859136:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.488106:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.488128:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.488144:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463450.492696:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788463450.492740:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 489944164711ns, next at 490944161171ns, rc = 0 00000004:00010000:3.0:1788463450.492842:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3100a4d reply state 00000000d88207fd transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.492870:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.492882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:3.0:1788463450.492886:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788463450.492893:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463450.493090:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+38:12388:x1875339466859136:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 5102us (5400us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788463450.493101:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 193 00000100:00100000:0.0:1788463450.499842:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463450.499882:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485804160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463450.500007:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463450.500171:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485804160 00000100:00100000:1.0:1788463450.500184:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485804160 00000100:00100000:1.0:1788463450.500658:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788463450.500670:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485804160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463450.500697:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788463450.500788:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485804160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463450.500795:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1788463450.500877:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463450.501159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485804160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463450.510132:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.511118:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466859264 00000100:00100000:0.0:1788463450.511131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466859264 00000100:00100000:0.0:1788463450.511186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 194 00000100:00100000:0.0:1788463450.511195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+38:12388:x1875339466859264:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463450.511226:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463450.511247:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476991 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.511303:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.511317:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.511336:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:0.0:1788463450.511340:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463450.511344:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0400, rc 0) 00000100:00100000:0.0:1788463450.511419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+39:12388:x1875339466859264:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 225us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.511426:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 194 00000100:00100000:2.0:1788463450.520216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.520326:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466859392 00000100:00100000:2.0:1788463450.520336:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466859392 00000100:00100000:2.0:1788463450.520390:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:2.0:1788463450.520399:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+6:2403:x1875339466859392:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788463450.522916:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2403:x1875339466859392:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 2507us (2697us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788463450.522929:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:2.0:1788463450.527676:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.527725:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466859648 00000100:00100000:2.0:1788463450.527735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466859648 00000100:00100000:2.0:1788463450.527789:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:2.0:1788463450.527799:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+39:12388:x1875339466859648:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788463450.528024:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+40:12388:x1875339466859648:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 226us (358us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788463450.528032:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:1.0:1788463450.535874:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.536001:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466859904 00000100:00100000:3.0:1788463450.536012:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466859904 00000100:00100000:3.0:1788463450.536074:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:3.0:1788463450.536084:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+40:12388:x1875339466859904:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788463450.536192:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+40:12388:x1875339466859904:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.536199:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 195 00000100:00100000:2.0:1788463450.540640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.540820:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860032 00000100:00100000:3.0:1788463450.540829:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860032 00000100:00100000:3.0:1788463450.540888:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:3.0:1788463450.540898:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+40:12388:x1875339466860032:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.540917:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463450.540937:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a438 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476998 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541024:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541042:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541055:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463450.541102:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463450.541121:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541148:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476998 expref: 42 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541168:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476998 expref: 41 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.541177:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:3.0:1788463450.541180:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788463450.541183:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:3.0:1788463450.541242:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+41:12388:x1875339466860032:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 345us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.541251:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 196 00000100:00100000:2.0:1788463450.555712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.557886:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860160 00000100:00100000:3.0:1788463450.557902:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860160 00000100:00100000:3.0:1788463450.557981:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:3.0:1788463450.558000:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466860160:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.558021:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463450.558042:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc47699f expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463450.558070:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c95a, blocks: 0x0 00010000:00010000:3.0:1788463450.558089:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788463450.558095:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463450.558105:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.558126:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.558142:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde000, rc 0) 00000100:00100000:3.0:1788463450.558202:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466860160:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 204us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.558209:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:3.0:1788463450.564503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.564741:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860416 00000100:00100000:2.0:1788463450.564752:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860416 00000100:00100000:2.0:1788463450.564816:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:2.0:1788463450.564827:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+41:12388:x1875339466860416:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463450.564966:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+41:12388:x1875339466860416:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 130us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463450.564974:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 197 00000100:00100000:2.0:1788463450.572849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.572953:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860544 00000100:00100000:1.0:1788463450.572975:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860544 00000100:00100000:1.0:1788463450.573033:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:1.0:1788463450.573044:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+8:12388:x1875339466860544:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463450.573064:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463450.573084:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769a6 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.573118:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.573137:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463450.573142:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463450.573149:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.573186:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.573201:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463450.573215:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485804288:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463450.573315:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463450.577305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.577339:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860672 00000100:00100000:0.0:1788463450.577348:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860672 00010000:00010000:0.0:1788463450.577384:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 10 pid: 8440 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.577419:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 89 00000100:00100000:0.0:1788463450.577427:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466860672:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463450.577443:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788463450.577556:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485804288:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463450.577604:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.577621:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:3.0:1788463450.577677:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+10:12388:x1875339466860544:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 4634us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.577699:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00010000:00010000:0.0:1788463450.578155:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.578180:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.578209:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3a446 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47699f expref: 9 pid: 8440 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.578223:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463450.578227:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463450.578237:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.578258:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.578298:0:6552:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.578312:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6552:1875339485804416:192.168.204.53@tcp:105: 00000100:00100000:0.0:1788463450.578389:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463450.592521:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6552:1875339485804416:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463450.592554:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463450.592649:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466860672:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 15220us (15352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.592660:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 89 00000100:00100000:0.0:1788463450.621846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.627809:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860800 00000100:00100000:2.0:1788463450.627824:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860800 00002000:00100000:3.0:1788463450.627947:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9617884d5500 x1875339466860800/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:586/0 lens 504/0 e 0 to 0 dl 1788463461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463450.627969:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884d5500 with x1875339466860800 ext(0->8) 00002000:00010000:3.0:1788463450.627975:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884d5500 00000100:00100000:3.0:1788463450.628003:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463450.628013:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466860800:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788463450.631432:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+10:2401:x1875339466860800:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 Request processed in 3400us (9576us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788463450.631447:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00002000:00100000:1.0:1788463450.631464:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9617884d5500 x1875339466860800/t4294967315(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:586/0 lens 504/448 e 0 to 0 dl 1788463461 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463450.631476:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884d5500 with x1875339466860800 ext(0->8) 00002000:00010000:1.0:1788463450.631483:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884d5500 00000100:00100000:3.0:1788463450.634662:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.634780:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466860928 00000100:00100000:1.0:1788463450.634791:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466860928 00000100:00100000:1.0:1788463450.634853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00100000:1.0:1788463450.634864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+41:12388:x1875339466860928:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788463450.636503:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1788463450.636518:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788463450.636563:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788463450.636700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485804544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463450.636778:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463450.636857:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485804544 00000100:00100000:0.0:1788463450.636863:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485804544 00000100:00100000:0.0:1788463450.636903:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463450.636911:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485804544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788463450.637053:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788463450.637057:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788463451 00002000:00010000:0.0:1788463450.637060:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788463450.637062:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788463450 -> 1788463451 00002000:00010000:0.0:1788463450.637064:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788463450.637105:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485804544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (326us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788463450.637113:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1788463450.637156:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9617884d4000/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788463450.637162:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485804544:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788463450.637263:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637274:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637282:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637288:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.637293:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637302:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637321:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463450.637325:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463450.637329:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637336:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a2e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637353:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637359:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637365:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637381:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.637384:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637390:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637398:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463450.637400:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463450.637403:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637408:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a327 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637420:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637427:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637432:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637438:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.637440:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637446:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637465:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:1.0:1788463450.637468:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463450.637472:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.637478:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a42a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463450.637499:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788463450.637510:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788463450.637621:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+19:12388:x1875339466860928:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 2757us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463450.637630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 198 00000100:00100000:2.0:1788463450.648427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.649604:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861056 00000100:00100000:1.0:1788463450.649618:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861056 00000100:00100000:1.0:1788463450.649682:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:1.0:1788463450.649694:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466861056:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788463450.654801:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788463450.654817:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788463450.655543:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466861056:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 5842us (7116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463450.655556:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:0.0:1788463450.664911:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.665002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861312 00000100:00100000:3.0:1788463450.665013:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861312 00000100:00100000:3.0:1788463450.665198:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 199 00000100:00100000:3.0:1788463450.665209:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+19:12388:x1875339466861312:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.665277:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463450.665304:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a43f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476998 expref: 19 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.665323:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:3.0:1788463450.665328:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463450.665357:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.665375:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.665384:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463450.665506:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003aac7a24 reply state 000000002ad2466e transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.665518:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.665523:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:3.0:1788463450.665526:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463450.665529:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463450.665660:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+20:12388:x1875339466861312:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 452us (759us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1788463450.665667:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 199 00000100:00100000:3.0:1788463450.670517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.670654:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861440 00000100:00100000:0.0:1788463450.670665:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861440 00000100:00100000:0.0:1788463450.670720:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:0.0:1788463450.670730:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466861440:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788463450.670900:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788463450.670904:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788463451 -> 1788463450 00002000:00010000:0.0:1788463450.670907:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788463448 00002000:00010000:0.0:1788463450.670909:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788463451 -> 1788463450 00002000:00010000:0.0:1788463450.670925:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788463450.671007:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466861440:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 277us (502us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788463450.671016:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463450.682842:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.682994:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861696 00000100:00100000:3.0:1788463450.683006:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861696 00000100:00100000:3.0:1788463450.683070:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 200 00000100:00100000:3.0:1788463450.683080:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+20:12388:x1875339466861696:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788463450.683152:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.683171:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 20 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.683201:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.683255:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 20 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.683270:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 20 pid: 10067 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463450.683402:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485804672:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463450.683653:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463450.693811:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.694017:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861824 00000100:00100000:1.0:1788463450.694027:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861824 00010000:00010000:1.0:1788463450.694070:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 21 pid: 10067 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463450.694110:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 90 00000100:00100000:1.0:1788463450.694134:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+21:2400:x1875339466861824:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463450.694150:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463450.694157:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 21 pid: 10067 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.694172:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 21 pid: 10067 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.694195:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:1.0:1788463450.694200:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.694210:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.694218:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.694239:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463450.694310:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+21:2400:x1875339466861824:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 178us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463450.694318:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 90 00010000:00010000:0.0:1788463450.694737:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1200/0x841acb7f42a3a423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47698a expref: 20 pid: 10067 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.694754:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485804672:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463450.694780:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694790:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694796:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694834:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694842:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694850:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694857:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463450.694862:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694881:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694892:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:0.0:1788463450.694895:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788463450.694899:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.694905:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a45b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.694975:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+19:12388:x1875339466861696:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 Request processed in 11896us (12143us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788463450.694984:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 200 00000100:00100000:3.0:1788463450.702331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.702565:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466861952 00000100:00100000:2.0:1788463450.702665:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466861952 00000100:00100000:2.0:1788463450.702813:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463450.702824:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466861952:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788463450.702868:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.702890:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.702899:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463450.702904:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463450.702909:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.702942:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.702967:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 8 pid: 8441 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.703000:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485804800:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463450.703141:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463450.718836:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485804800:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463450.718871:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463450.720759:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463450.722344:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862080 00000100:00100000:0.0:1788463450.722357:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862080 00010000:00010000:0.0:1788463450.722398:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 9 pid: 8441 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.722447:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 91 00000100:00100000:0.0:1788463450.722456:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466862080:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463450.722475:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463450.722508:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 9 pid: 8441 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722524:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 9 pid: 8441 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722545:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e248494a/0x841acb7f42a3a44d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769a6 expref: 9 pid: 8441 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722560:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463450.722564:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463450.722571:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722606:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722642:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463450.722703:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466862080:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 247us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.722711:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 91 00010000:00010000:0.0:1788463450.722825:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722835:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722868:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722877:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722884:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722891:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463450.722895:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722905:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722915:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463450.722922:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aca7d05/0x841acb7f42a3a462 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463450.722984:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466861952:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 20162us (20666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463450.722992:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463450.735123:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.735911:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862336 00000100:00100000:2.0:1788463450.735922:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862336 00000100:00100000:2.0:1788463450.735990:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 201 00000100:00100000:2.0:1788463450.736001:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+19:12388:x1875339466862336:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463450.736082:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.736101:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.736111:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.736145:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.736160:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 19 pid: 6522 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.736175:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485804928:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463450.736870:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463450.739297:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485804928:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463450.739329:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463450.740034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463450.740101:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862464 00000100:00100000:2.0:1788463450.740109:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862464 00010000:00010000:2.0:1788463450.740142:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 20 pid: 6522 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.740190:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 92 00000100:00100000:2.0:1788463450.740198:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+20:2401:x1875339466862464:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463450.740213:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463450.740221:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 20 pid: 6522 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740233:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 20 pid: 6522 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740258:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813200/0x841acb7f42a3a2b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47692f expref: 20 pid: 6522 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740277:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.740282:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740292:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740300:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740320:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463450.740360:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+19:2401:x1875339466862464:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 162us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463450.740366:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 92 00010000:00010000:2.0:1788463450.740387:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740400:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740558:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740569:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740600:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740644:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.740658:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 19 pid: 6523 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.740670:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485805056:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463450.740731:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b45180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463450.743760:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485805056:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463450.743796:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.745973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463450.746140:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862592 00000100:00100000:1.0:1788463450.746150:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862592 00010000:00010000:1.0:1788463450.746195:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 20 pid: 6523 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463450.746253:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 93 00000100:00100000:1.0:1788463450.746264:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+20:2400:x1875339466862592:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463450.746284:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463450.746292:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 20 pid: 6523 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746307:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 20 pid: 6523 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746332:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476991 expref: 20 pid: 6523 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746349:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:1.0:1788463450.746355:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746363:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746370:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746397:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463450.746448:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+19:2400:x1875339466862592:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 186us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463450.746455:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 93 00010000:00010000:1.0:1788463450.746481:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.746495:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463450.747198:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788463450.747827:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1788463450.747872:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788463450.748003:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485805184:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788463450.750320:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463450.750371:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463450.750455:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485805184 00000100:00100000:2.0:1788463450.750466:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485805184 00000100:00100000:2.0:1788463450.750534:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788463450.750545:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485805184:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463450.750872:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485805184:12345-0@lo:1000:mdt00_004.0 Request processed in 327us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463450.750892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788463450.750913:0:12162:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788463450.750920:0:12162:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9617884d4000, transno 4294967316 00000100:00100000:0.0:1788463450.750939:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485805184:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788463450.751459:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:0.0:1788463450.751535:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485805312:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788463450.751612:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463450.751635:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c20780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463450.752560:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485805312 00000100:00100000:2.0:1788463450.752569:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485805312 00000100:00100000:2.0:1788463450.752838:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788463450.752850:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485805312:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463450.753044:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12162:x1875339485805312:12345-0@lo:1000:mdt00_004.0 Request processed in 197us (1432us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788463450.753053:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788463450.753150:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485805312:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788463450.753199:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753211:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753220:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753227:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.753232:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753241:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753258:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:1.0:1788463450.753262:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463450.753268:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753274:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a470 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753306:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753313:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753319:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753324:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdee00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463450.753326:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753331:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753339:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:1.0:1788463450.753341:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463450.753344:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753351:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a3ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753373:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753389:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753398:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753525:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463450.753541:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 22 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463450.753554:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485805440:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463450.753856:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788463450.757336:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463450.758706:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788405500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485805440:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463450.758741:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.771111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.771714:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862720 00000100:00100000:3.0:1788463450.771725:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862720 00010000:00010000:3.0:1788463450.771803:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 23 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463450.771847:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 94 00000100:00100000:3.0:1788463450.771870:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+23:2401:x1875339466862720:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463450.771887:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463450.771896:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 23 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.771913:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 23 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.771938:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a3c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476975 expref: 23 pid: 6524 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.771967:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:3.0:1788463450.771974:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.771985:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.771995:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.772031:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463450.772089:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+22:2401:x1875339466862720:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 223us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463450.772097:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 94 00010000:00010000:2.0:1788463450.772237:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772514:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772529:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772536:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772543:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772549:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.772553:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772561:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772869:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.772873:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463450.772879:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772885:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a477 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772901:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772908:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772914:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772919:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463450.772923:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772929:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772938:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961787b68200) 00010000:00010000:2.0:1788463450.772941:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463450.772944:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463450.772960:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a469 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463450.773514:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+21:12388:x1875339466862336:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 37510us (38397us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788463450.773524:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 201 00000020:00080000:2.0:1788463450.773530:0:12162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788463450.778989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463450.779025:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466862976 00000100:00100000:3.0:1788463450.779035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466862976 00000100:00100000:3.0:1788463450.779086:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463450.779121:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618836c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+21:12388:x1875339466862976:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788463450.779385:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788463450.779421:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788463450.779455:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779471:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779484:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779493:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779500:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779507:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.779526:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788463450.780728:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463450.780737:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463450.781520:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788463450.781533:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463450.783095:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618836c1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+23:12388:x1875339466862976:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 3978us (4104us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788463450.783111:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 50 00000020:00080000:3.0:1788463450.783120:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788463450.783197:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463450.783204:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.783214:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfc00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463450.783226:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.783238:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.783255:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00010000:00010000:3.0:1788463450.783259:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788463450.783264:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.783271:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a47e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463450.783284:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463450.783286:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463450.783288:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463450.912334:0:14620:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463450.912342:0:14620:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463450.912365:0:14620:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788463450.912371:0:14620:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463451.106607:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.106824:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466863232 00000100:00100000:0.0:1788463451.106835:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466863232 00000100:00100000:0.0:1788463451.106898:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 202 00000100:00100000:0.0:1788463451.106909:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+23:12399:x1875339466863232:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463451.106936:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463451.106967:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a485 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769ad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.107085:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a48c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.107100:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a48c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.107241:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a48c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463451.107262:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788463451.107367:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a485 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ad expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.107385:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a48c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ad expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.107395:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463451.107399:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788463451.107403:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1400, rc 0) 00000100:00100000:0.0:1788463451.107470:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+25:12399:x1875339466863232:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 562us (872us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788463451.107478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 202 00000100:00100000:0.0:1788463451.123222:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.123492:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466863360 00000100:00100000:0.0:1788463451.123502:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466863360 00000100:00100000:0.0:1788463451.123556:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 203 00000100:00100000:0.0:1788463451.123566:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+25:12399:x1875339466863360:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:0.0:1788463451.123656:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123674:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123686:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123702:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123721:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123729:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123807:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123816:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123823:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463451.123867:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123880:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123887:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123894:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123900:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.123905:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123912:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123930:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463451.123933:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.123939:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123958:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a49a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123969:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123976:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123983:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.123989:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.123993:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124000:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124008:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9ba00) 00010000:00010000:0.0:1788463451.124011:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.124014:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124032:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a4a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124058:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124065:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124072:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124077:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.124080:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124088:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124096:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9bf00) 00010000:00010000:0.0:1788463451.124099:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.124102:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.124109:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a4a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.124176:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+25:12399:x1875339466863360:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 611us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.124184:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 203 00000100:00100000:2.0:1788463451.205039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.205157:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466863616 00000100:00100000:1.0:1788463451.205169:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466863616 00000100:00100000:1.0:1788463451.205239:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 204 00000100:00100000:1.0:1788463451.205250:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+25:12402:x1875339466863616:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463451.205273:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463451.205297:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a4af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769b4 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205376:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205394:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205407:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205440:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205448:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205455:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205622:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205632:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205639:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463451.205649:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788463451.205737:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205745:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205752:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205759:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463451.205764:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205783:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205796:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:1.0:1788463451.205799:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463451.205804:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205811:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3a4b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205824:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205831:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205838:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205843:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463451.205846:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205852:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205857:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9d600) 00010000:00010000:1.0:1788463451.205859:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463451.205862:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205878:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205917:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a4af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 28 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205932:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 27 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.205939:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:1.0:1788463451.206715:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463451.206721:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463451.206799:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+27:12402:x1875339466863616:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1547us (1768us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788463451.206807:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 204 00000100:00100000:2.0:1788463451.217334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.217414:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466863744 00000100:00100000:1.0:1788463451.217424:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466863744 00000100:00100000:1.0:1788463451.217491:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 205 00000100:00100000:1.0:1788463451.217501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+27:12402:x1875339466863744:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:1.0:1788463451.217615:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217633:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217646:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217712:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217721:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217728:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217735:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463451.217740:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217750:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217762:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:1.0:1788463451.217765:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463451.217769:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.217777:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a4d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463451.217838:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+27:12402:x1875339466863744:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 338us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463451.217845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 205 00000100:00100000:0.0:1788463451.226011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.226091:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864000 00000100:00100000:3.0:1788463451.226101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864000 00000100:00100000:3.0:1788463451.226161:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:3.0:1788463451.226172:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+27:12402:x1875339466864000:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463451.226404:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+28:12402:x1875339466864000:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 233us (403us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788463451.226422:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:2.0:1788463451.318725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.318954:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864256 00000100:00100000:0.0:1788463451.318965:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864256 00000100:00100000:3.0:1788463451.319099:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 206 00000100:00100000:3.0:1788463451.319110:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b2ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+28:11932:x1875339466864256:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463451.319143:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463451.319169:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a4d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769bb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.319477:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.319496:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 29 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.319507:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.319542:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 29 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.319556:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 29 pid: 12162 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.319570:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485805568:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463451.319892:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463451.334306:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.334637:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864384 00000100:00100000:1.0:1788463451.334648:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864384 00010000:00010000:1.0:1788463451.334715:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 30 pid: 12162 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463451.334775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 95 00000100:00100000:1.0:1788463451.334786:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+30:2401:x1875339466864384:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463451.334804:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463451.334812:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 30 pid: 12162 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.334827:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 30 pid: 12162 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.334850:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:1.0:1788463451.334856:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.334866:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.334875:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.334895:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463451.334963:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+30:2401:x1875339466864384:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 179us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463451.334971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 95 00010000:00010000:3.0:1788463451.335260:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a4c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769b4 expref: 29 pid: 12162 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.335276:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875339485805568:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463451.335299:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.335319:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.335326:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463451.335345:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788463451.335542:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a4d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.335558:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.335566:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:3.0:1788463451.335570:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463451.335614:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf800, rc 0) 00000100:00100000:3.0:1788463451.335657:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b2ef5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+29:11932:x1875339466864256:12345-192.168.204.53@tcp:101:bash.0 Request processed in 16549us (16943us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788463451.335666:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 206 00000100:00100000:2.0:1788463451.344209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.344286:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864512 00000100:00100000:1.0:1788463451.344297:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864512 00000100:00100000:1.0:1788463451.344359:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 207 00000100:00100000:1.0:1788463451.344371:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+29:11932:x1875339466864512:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:1.0:1788463451.344414:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463451.344435:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769c2 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344473:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344487:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344499:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344696:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c2 expref: 31 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344728:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c2 expref: 30 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.344736:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:1.0:1788463451.344740:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463451.344744:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:1.0:1788463451.344794:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+30:11932:x1875339466864512:12345-192.168.204.53@tcp:101:bash.0 Request processed in 425us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463451.344801:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 207 00000100:00100000:1.0:1788463451.360876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463451.368521:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864768 00000100:00100000:2.0:1788463451.368538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864768 00000100:00100000:2.0:1788463451.368636:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 208 00000100:00100000:2.0:1788463451.368647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+30:11932:x1875339466864768:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:2.0:1788463451.370041:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.370063:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.370075:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463451.370118:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1788463451.370142:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031a3d2b0 reply state 0000000082dc1e0a transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.370155:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.370177:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:2.0:1788463451.370180:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463451.370186:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788463451.370387:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1788463451.370627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+34:11932:x1875339466864768:12345-192.168.204.53@tcp:36:bash.0 Request processed in 1978us (9758us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788463451.370636:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 208 00000020:00080000:2.0:1788463451.370641:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788463451.376667:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.376827:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466864896 00000100:00100000:3.0:1788463451.376837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466864896 00000100:00100000:3.0:1788463451.376895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 209 00000100:00100000:3.0:1788463451.376904:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+34:11932:x1875339466864896:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463451.376930:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463451.376962:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769c9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.377053:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c9 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.377068:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a503 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c9 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.377086:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:3.0:1788463451.377090:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463451.377093:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfc00, rc 0) 00000100:00100000:3.0:1788463451.377156:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+35:11932:x1875339466864896:12345-192.168.204.53@tcp:101:bash.0 Request processed in 252us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.377164:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 209 00000100:00100000:0.0:1788463451.397330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.397436:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865024 00000100:00100000:3.0:1788463451.397447:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865024 00000100:00100000:3.0:1788463451.397525:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:3.0:1788463451.397537:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:11932:x1875339466865024:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463451.397558:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463451.397622:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769d0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463451.397651:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a99c95a, atime: 0x6a99c958, ctime: 0x6a99c95a, blocks: 0x8 00010000:00010000:3.0:1788463451.397672:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=490s v=(0 0) 00010000:00010000:3.0:1788463451.397685:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463451.397695:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.397751:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.397766:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf000, rc 0) 00000100:00100000:3.0:1788463451.397819:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:11932:x1875339466865024:12345-192.168.204.53@tcp:101:bash.0 Request processed in 285us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.397826:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00080000:0.0:1788463451.399153:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463451.402238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.402389:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865152 00000100:00100000:1.0:1788463451.402410:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865152 00002000:00010000:1.0:1788463451.402462:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788463451.402481:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884d6680 with x1875339466865152 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463451.402496:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884d6680. 00000100:00100000:1.0:1788463451.402533:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:1.0:1788463451.402543:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466865152:12345-192.168.204.53@tcp:10:bash.0 00002000:00010000:1.0:1788463451.402879:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788463451.402883:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788463450 -> 1788463451 00002000:00010000:1.0:1788463451.402885:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788463448 -> 1788463448 00002000:00010000:1.0:1788463451.402888:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788463450 -> 1788463451 00002000:00010000:1.0:1788463451.402890:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788463451.402965:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466865152:12345-192.168.204.53@tcp:10:bash.0 Request processed in 422us (749us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788463451.402974:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00002000:00010000:1.0:1788463451.402978:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1788463451.402982:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9617884d6680 with x1875339466865152 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463451.402986:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9617884d6680. 00000100:00100000:2.0:1788463451.521862:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.521976:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865280 00000100:00100000:0.0:1788463451.521987:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865280 00000100:00100000:0.0:1788463451.522054:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 210 00000100:00100000:0.0:1788463451.522065:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:12416:x1875339466865280:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:0.0:1788463451.522160:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522179:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522192:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522218:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522227:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522234:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522303:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522313:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522321:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463451.522377:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522389:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522976:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522989:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.522995:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.522999:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523007:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523020:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463451.523024:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.523029:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523034:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a511 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523048:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523054:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523068:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523073:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.523076:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523083:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523091:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:0.0:1788463451.523094:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.523096:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523101:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a518 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523117:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523122:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523127:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523131:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.523134:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523148:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523156:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:0.0:1788463451.523159:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.523161:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.523166:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.523293:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+35:12416:x1875339466865280:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 1228us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.523302:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 210 00000100:00100000:2.0:1788463451.523746:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463451.523763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485805696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463451.523811:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463451.523872:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485805696 00000100:00100000:2.0:1788463451.523878:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485805696 00000100:00100000:2.0:1788463451.523933:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463451.523955:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875339485805696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463451.523982:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463451.524022:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875339485805696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.524028:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788463451.524045:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463451.524081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485805696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463451.524288:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485805824:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524324:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485806336:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524373:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485806848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524501:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524520:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788463451.524527:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485805952:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524561:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485806464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524596:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524612:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485806976:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.524656:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806848 00000100:00100000:3.0:1788463451.524659:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806848 00000100:00100000:3.0:1788463451.524690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485805952 00000100:00100000:3.0:1788463451.524704:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485805952 00000100:00100000:3.0:1788463451.524720:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806464 00000100:00100000:3.0:1788463451.524723:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806464 00000100:00100000:3.0:1788463451.524737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806976 00000100:00100000:3.0:1788463451.524739:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806976 00000100:00100000:3.0:1788463451.524754:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788463451.524760:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485806848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524797:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485806848:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.524804:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788463451.524818:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788463451.524824:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485805952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524848:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485805952:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.524853:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788463451.524863:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788463451.524868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485806464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524894:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485806464:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.524899:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788463451.524911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788463451.524917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485806976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.524956:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485806976:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463451.524962:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788463451.524992:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485805952:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.525015:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485806464:0@lo:400:kworker.0 00010000:00080000:3.0:1788463451.525026:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf30a80 x1875339485806976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463451.525036:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485806976:0@lo:400:kworker.0 00000100:00100000:3.0:1788463451.525045:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485806848:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.525194:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806336 00000100:00100000:2.0:1788463451.525199:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806336 00000100:00100000:2.0:1788463451.525226:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788463451.525234:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485806336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.525282:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485806336:12345-0@lo:400:kworker.0 Request processed in 49us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.525288:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:2.0:1788463451.525303:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463451.525307:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463451.525317:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485806080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.525341:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463451.525359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485806592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.525379:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463451.525392:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485807104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.525615:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485806208:0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.525646:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.525668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485806720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.525692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.525724:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806080 00000100:00100000:0.0:1788463451.525728:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806080 00000100:00100000:0.0:1788463451.525757:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788463451.525764:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485806080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.525795:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485806080:12345-0@lo:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.525800:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788463451.525850:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806720 00000100:00100000:0.0:1788463451.525853:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806720 00000100:00100000:0.0:1788463451.525899:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788463451.525906:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485806720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.525948:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485806720:12345-0@lo:400:kworker.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.525954:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788463451.525972:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463451.525983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463451.526007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.526036:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485806720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.526057:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485807232 00000100:00100000:0.0:1788463451.526060:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485807232 00000100:00100000:0.0:1788463451.526089:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788463451.526094:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485807232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463451.526349:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463451.526382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485806080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.526951:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485806336:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.526972:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485807104 00000100:00100000:2.0:1788463451.526976:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485807104 00000100:00100000:2.0:1788463451.527007:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788463451.527014:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485807104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.527050:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875339485807104:12345-0@lo:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.527056:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788463451.527081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485807104:0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.527097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806592 00000100:00100000:2.0:1788463451.527099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806592 00000100:00100000:2.0:1788463451.527135:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485806208 00000100:00100000:2.0:1788463451.527138:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485806208 00000100:00100000:2.0:1788463451.527160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788463451.527165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485806592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.527198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485806592:12345-0@lo:400:kworker.0 Request processed in 33us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.527204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788463451.527215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788463451.527221:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463451.527252:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485806208:12345-0@lo:400:kworker.0 Request processed in 31us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.527257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00080000:2.0:1788463451.527282:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf31180 x1875339485806592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463451.527293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485806592:0@lo:400:kworker.0 00000100:00080000:2.0:1788463451.527333:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463451.527337:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463451.527384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485806208:0@lo:400:kworker.0 00002000:00000024:0.0:1788463451.527509:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463451.527669:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485805824 00000100:00100000:1.0:1788463451.527674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485805824 00000100:00100000:1.0:1788463451.527707:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788463451.527714:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463451.527755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485805824:12345-0@lo:400:kworker.0 Request processed in 42us (3430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463451.527761:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788463451.527801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485805824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463451.534068:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485807232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7962us (8048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.534086:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463451.542015:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485807232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463451.568675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.568786:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865536 00000100:00100000:0.0:1788463451.568796:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865536 00000100:00100000:0.0:1788463451.568859:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 211 00000100:00100000:0.0:1788463451.568869:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+35:12419:x1875339466865536:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463451.568891:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463451.568914:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a526 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769d7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569002:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569025:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569040:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569057:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569064:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569072:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569181:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a53b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569191:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463451.569207:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788463451.569294:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569303:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569309:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569322:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.569326:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569335:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569347:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463451.569350:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.569354:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569361:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a52d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569375:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569381:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569387:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569392:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.569406:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569413:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:0.0:1788463451.569438:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.569441:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569448:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a534 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569489:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a526 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d7 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569501:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d7 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.569509:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:0.0:1788463451.569511:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788463451.569513:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1600, rc 0) 00000100:00100000:0.0:1788463451.569631:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+37:12419:x1875339466865536:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 761us (965us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788463451.569639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 211 00000100:00100000:1.0:1788463451.575608:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463451.575708:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865664 00000100:00100000:2.0:1788463451.575719:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865664 00000100:00100000:2.0:1788463451.575778:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 212 00000100:00100000:2.0:1788463451.575790:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+37:12419:x1875339466865664:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:2.0:1788463451.575858:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.575894:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.575905:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.575951:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.575966:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 37 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.575980:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485807360:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463451.576069:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463451.579926:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485807360:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463451.579971:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463451.581856:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.582059:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466865920 00000100:00100000:3.0:1788463451.582070:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466865920 00000100:00100000:3.0:1788463451.582137:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:3.0:1788463451.582148:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+38:6172:x1875339466865920:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788463451.582448:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+39:6172:x1875339466865920:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 300us (599us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788463451.582456:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:3.0:1788463451.585774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463451.585865:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466866048 00000100:00100000:2.0:1788463451.585875:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466866048 00010000:00010000:2.0:1788463451.585919:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 39 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.585967:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 96 00000100:00100000:2.0:1788463451.585978:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+39:2401:x1875339466866048:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463451.585992:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463451.586011:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 39 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586023:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 39 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586044:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf800/0x841acb7f42a3a4e0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769bb expref: 39 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586059:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:2.0:1788463451.586065:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586073:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586080:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.586124:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463451.586184:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+38:2401:x1875339466866048:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 207us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.586192:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 96 00010000:00010000:0.0:1788463451.587075:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587085:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587140:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587159:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587166:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587172:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.587177:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587184:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587197:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:0.0:1788463451.587200:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463451.587204:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.587210:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.587293:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+37:12419:x1875339466865664:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 11504us (11728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.587303:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 212 00000100:00100000:3.0:1788463451.591354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.591492:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466866304 00000100:00100000:1.0:1788463451.591503:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466866304 00000100:00100000:1.0:1788463451.591564:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:1.0:1788463451.591603:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+37:12419:x1875339466866304:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:1.0:1788463451.591824:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+38:12419:x1875339466866304:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 251us (479us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788463451.591833:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:2.0:1788463451.706533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.706605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466866560 00000100:00100000:3.0:1788463451.706616:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466866560 00000100:00100000:3.0:1788463451.706679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 213 00000100:00100000:3.0:1788463451.706689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+38:12430:x1875339466866560:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:3.0:1788463451.706712:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463451.706735:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a550 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769de expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706812:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706848:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706859:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706873:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706880:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.706885:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707022:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707031:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707038:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463451.707047:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788463451.707139:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707147:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707153:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707165:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463451.707169:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707176:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707188:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463451.707191:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463451.707196:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707203:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707220:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707234:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707239:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707244:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463451.707246:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707252:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707270:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961885469200) 00010000:00010000:3.0:1788463451.707273:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463451.707276:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707281:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a55e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707320:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a550 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769de expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707331:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769de expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.707337:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:3.0:1788463451.707339:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463451.707341:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde000, rc 0) 00000100:00100000:3.0:1788463451.707908:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+40:12430:x1875339466866560:12345-192.168.204.53@tcp:101:cat.0 Request processed in 1218us (1382us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788463451.707917:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 213 00000100:00100000:0.0:1788463451.714454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.714602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466866816 00000100:00100000:1.0:1788463451.714611:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466866816 00000100:00100000:1.0:1788463451.714667:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:1.0:1788463451.714677:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+40:12430:x1875339466866816:12345-192.168.204.53@tcp:35:cat.0 00000100:00100000:1.0:1788463451.714967:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+41:12430:x1875339466866816:12345-192.168.204.53@tcp:35:cat.0 Request processed in 291us (522us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788463451.714975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:2.0:1788463451.748236:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.748332:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867072 00000100:00100000:0.0:1788463451.748342:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867072 00000100:00100000:0.0:1788463451.748413:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 214 00000100:00100000:0.0:1788463451.748423:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+41:12431:x1875339466867072:12345-192.168.204.53@tcp:36:rm.0 00010000:00010000:0.0:1788463451.748502:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788463451.748530:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfc00/0x841acb7f42a3a503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c9 expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748555:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3a565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769de expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748567:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a53b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d7 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748624:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c600/0x841acb7f42a3a4f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769c2 expref: 38 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748636:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:0.0:1788463451.748641:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463451.748665:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748691:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748701:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748716:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748722:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748738:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748817:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748824:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.748830:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463451.749055:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788463451.749064:0:10067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491200488971ns, next at 492200486710ns, rc = 0 00010000:00010000:0.0:1788463451.749120:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749129:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749137:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749143:0:10067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749149:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749155:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749190:0:10067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463451.749212:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749219:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749225:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749232:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.749236:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749244:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749253:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:1.0:1788463451.749255:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463451.749256:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788463451.749261:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749261:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749268:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463451.749268:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a581 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749272:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749278:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749282:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749286:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:0.0:1788463451.749287:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749289:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463451.749292:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749303:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749304:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a588 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749308:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463451.749311:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.749314:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463451.749315:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463451.749317:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463451.749317:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749324:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463451.749326:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463451.749329:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749335:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0800/0x841acb7f42a3a573 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463451.749345:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001efe7eb0 reply state 000000006abeb881 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749355:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.749361:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:0.0:1788463451.749363:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463451.749365:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463451.749448:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+39:12431:x1875339466867072:12345-192.168.204.53@tcp:36:rm.0 Request processed in 1025us (1228us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788463451.749456:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 214 00010000:00010000:0.0:1788463451.781786:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463451.807697:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463451.807948:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867328 00000100:00100000:2.0:1788463451.807962:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867328 00000100:00100000:2.0:1788463451.808045:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 215 00000100:00100000:2.0:1788463451.808056:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+39:12437:x1875339466867328:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463451.808103:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463451.808141:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a58f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769e5 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808418:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808434:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808448:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808462:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808469:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808474:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463451.808831:0:12162:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788463451.808977:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808986:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.808994:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809040:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809048:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809055:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809062:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463451.809067:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809075:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809086:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463451.809090:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463451.809094:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809102:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a596 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463451.809185:0:12162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e039891 reply state 000000002ced1688 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809198:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809204:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:2.0:1788463451.809213:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463451.809216:0:12162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463451.809313:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a58f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 42 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809327:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 41 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.809334:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:2.0:1788463451.809337:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463451.809339:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20000, rc 0) 00000100:00100000:2.0:1788463451.809466:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+42:12437:x1875339466867328:12345-192.168.204.53@tcp:101:bash.0 Request processed in 1411us (1780us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788463451.809474:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 215 00000100:00100000:1.0:1788463451.813986:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463451.814076:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867456 00000100:00100000:0.0:1788463451.814088:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867456 00000100:00100000:0.0:1788463451.814404:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:0.0:1788463451.814416:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466867456:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463451.814435:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463451.814457:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769ec expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463451.814484:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463451.814506:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1788463451.814511:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463451.814520:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.814538:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.814552:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0800, rc 0) 00000100:00100000:0.0:1788463451.814646:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2402:x1875339466867456:12345-192.168.204.53@tcp:101:bash.0 Request processed in 232us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.814653:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00080000:2.0:1788463451.814747:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463451.818634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463451.818738:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867584 00000100:00100000:2.0:1788463451.818749:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867584 00000100:00100000:2.0:1788463451.818815:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:2.0:1788463451.818826:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:12437:x1875339466867584:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463451.818844:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463451.818864:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769f3 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.818899:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 9 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.818909:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463451.818914:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463451.818945:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.819001:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 9 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.819016:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 9 pid: 9857 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.819031:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485807488:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463451.819147:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463451.822951:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463451.823183:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867712 00000100:00100000:3.0:1788463451.823196:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867712 00010000:00010000:3.0:1788463451.823250:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 10 pid: 9857 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.823297:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 97 00000100:00100000:3.0:1788463451.823322:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466867712:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463451.823339:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463451.823363:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 10 pid: 9857 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.823379:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 10 pid: 9857 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.823412:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463451.823418:0:6552:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463451.823427:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.823437:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.823476:0:6552:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.823491:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6552:1875339485807616:192.168.204.53@tcp:105: 00000100:00100000:3.0:1788463451.823752:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66900 going to sleep for 11 seconds 00010000:00010000:2.0:1788463451.824201:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ec expref: 10 pid: 9857 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.824280:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8440:1875339485807488:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463451.824311:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.824322:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20600, rc 0) 00000100:00100000:2.0:1788463451.824360:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+9:12437:x1875339466867584:12345-192.168.204.53@tcp:101:bash.0 Request processed in 5536us (5737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.824368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:0.0:1788463451.827947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463451.828026:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466867968 00000100:00100000:1.0:1788463451.828035:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466867968 00000100:00100000:1.0:1788463451.828090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:1.0:1788463451.828101:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+42:12437:x1875339466867968:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:1.0:1788463451.828488:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+43:12437:x1875339466867968:12345-192.168.204.53@tcp:35:bash.0 Request processed in 389us (561us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788463451.828496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:3.0:1788463451.829785:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6552:1875339485807616:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463451.829810:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463451.830022:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466867712:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 6701us (7095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.830031:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 97 00000100:00100000:1.0:1788463452.036682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485807744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463452.036762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463452.036849:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485807744 00000100:00100000:1.0:1788463452.036857:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485807744 00000100:00100000:1.0:1788463452.036912:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788463452.036923:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485807744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463452.036994:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788463452.037064:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485807744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.037072:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788463452.037124:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485807744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463452.137659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.137837:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868096 00000100:00100000:2.0:1788463452.137852:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868096 00000100:00100000:2.0:1788463452.137961:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 216 00000100:00100000:2.0:1788463452.137985:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+43:12453:x1875339466868096:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463452.138013:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.138035:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a5c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc4769fa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.138113:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.138128:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463452.138139:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463452.138141:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463452.138183:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788463452.138188:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463452.138206:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.138242:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a5c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769fa expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.138261:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769fa expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.138270:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463452.138273:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463452.138292:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20800, rc 0) 00000100:00100000:2.0:1788463452.138363:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+44:12453:x1875339466868096:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 392us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.138371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 216 00000100:00100000:0.0:1788463452.156916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.157268:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868352 00000100:00100000:3.0:1788463452.157283:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868352 00000100:00100000:3.0:1788463452.157370:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 217 00000100:00100000:3.0:1788463452.157439:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+44:12453:x1875339466868352:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463452.157495:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.157550:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a01 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.157916:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a5d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.157949:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.157969:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463452.157989:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788463452.158176:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a01 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.158208:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a01 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.158221:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:3.0:1788463452.158225:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463452.158230:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde200, rc 0) 00000100:00100000:3.0:1788463452.158349:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+46:12453:x1875339466868352:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 916us (1444us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788463452.158365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 217 00000100:00100000:0.0:1788463452.165331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.165448:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868608 00000100:00100000:2.0:1788463452.165462:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868608 00000100:00100000:2.0:1788463452.165565:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 218 00000100:00100000:2.0:1788463452.165608:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+46:12453:x1875339466868608:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463452.165641:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.165669:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a5e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a08 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.165828:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.165847:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.165863:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463452.165878:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788463452.166032:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a5e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a08 expref: 49 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.166055:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a08 expref: 48 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.166066:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:2.0:1788463452.166087:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463452.166092:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21c00, rc 0) 00000100:00100000:2.0:1788463452.166165:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+48:12453:x1875339466868608:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 590us (852us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788463452.166173:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 218 00000100:00100000:1.0:1788463452.167017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.167174:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868736 00000100:00100000:3.0:1788463452.167184:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868736 00000100:00100000:3.0:1788463452.167264:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:3.0:1788463452.167274:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+48:2402:x1875339466868736:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463452.167288:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463452.167309:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a5d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a01 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.167325:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:3.0:1788463452.167330:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463452.167376:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+47:2402:x1875339466868736:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.167383:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:3.0:1788463452.178276:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.179434:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868864 00000100:00100000:0.0:1788463452.179458:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868864 00000100:00100000:0.0:1788463452.179653:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:0.0:1788463452.179674:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466868864:12345-192.168.204.53@tcp:1:lfs.0 00010000:00010000:0.0:1788463452.179758:0:9857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.180456:0:9857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.180470:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463452.180866:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463452.180874:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.180944:0:9857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.180963:0:9857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 8 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463452.180985:0:9857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9857:1875339485807872:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463452.181135:0:9857:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.187533:0:9857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9857:1875339485807872:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463452.187568:0:9857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.187909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463452.187965:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466868992 00000100:00100000:1.0:1788463452.187974:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466868992 00002000:00100000:1.0:1788463452.188476:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff96188cf32a00 x1875339466868992/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:588/0 lens 504/0 e 0 to 0 dl 1788463463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463452.188488:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188cf32a00 with x1875339466868992 ext(0->8) 00010000:00010000:1.0:1788463452.188498:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 9 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.188514:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 9 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463452.188523:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96188cf32a00 00000100:00100000:1.0:1788463452.189030:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463452.189044:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466868992:12345-192.168.204.53@tcp:4:lfs.0 00000100:00100000:1.0:1788463452.193328:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+11:2400:x1875339466868992:12345-192.168.204.53@tcp:4:lfs.0 Request processed in 4272us (5412us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788463452.193348:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00002000:00100000:1.0:1788463452.193366:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff96188cf32a00 x1875339466868992/t4294967309(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:588/0 lens 504/448 e 0 to 0 dl 1788463463 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463452.193377:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188cf32a00 with x1875339466868992 ext(0->8) 00010000:00010000:1.0:1788463452.193389:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.193436:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463452.193448:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff96188cf32a00 00000100:00100000:0.0:1788463452.202131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.202419:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466869120 00000100:00100000:3.0:1788463452.202433:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466869120 00010000:00010000:3.0:1788463452.202502:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.202662:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 98 00000100:00100000:3.0:1788463452.202674:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+11:2400:x1875339466869120:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463452.202695:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788463452.202722:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788463452.202726:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788463452 00002000:00010000:3.0:1788463452.202729:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788463452 00002000:00010000:3.0:1788463452.202731:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788463452 00002000:00010000:3.0:1788463452.202734:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788463452.202760:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.202778:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.203624:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf9a3a0/0x841acb7f42a3a5b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769f3 expref: 11 pid: 8440 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.203650:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463452.203655:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463452.203663:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.203676:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.203860:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463452.203951:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466869120:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 1277us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.203962:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 98 00010000:00010000:1.0:1788463452.204092:0:9857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204104:0:9857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204137:0:9857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204147:0:9857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204157:0:9857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204164:0:9857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463452.204169:0:9857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204179:0:9857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204212:0:9857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.204732:0:9857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038953b6/0x841acb7f42a3a5f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463452.205074:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466868864:12345-192.168.204.53@tcp:1:lfs.0 Request processed in 25405us (26812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.205085:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:2.0:1788463452.209127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.209287:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466869376 00000100:00100000:3.0:1788463452.209301:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466869376 00000100:00100000:3.0:1788463452.209409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:3.0:1788463452.209422:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961886cfec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+47:12453:x1875339466869376:12345-192.168.204.53@tcp:35:lfs.0 00000004:00010000:3.0:1788463452.209540:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a08 expref: 47 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463452.209842:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788463452.209880:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788463452.210279:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788463452.210348:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.210366:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 51 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.210377:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.210423:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 51 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.210440:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 51 pid: 12162 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.210456:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485808000:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463452.210564:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463452.219957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.220186:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466869504 00000100:00100000:0.0:1788463452.220216:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466869504 00010000:00010000:0.0:1788463452.220265:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 52 pid: 12162 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463452.220311:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 99 00000100:00100000:0.0:1788463452.220321:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+52:2401:x1875339466869504:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463452.220338:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463452.220346:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 52 pid: 12162 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.220361:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 52 pid: 12162 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.220388:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:0.0:1788463452.220394:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.220405:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.220413:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.220435:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463452.220511:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+52:2401:x1875339466869504:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 183us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.220520:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 99 00010000:00010000:2.0:1788463452.220690:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a5a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769e5 expref: 51 pid: 12162 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.220713:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875339485808000:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463452.220742:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.220753:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.220760:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463452.220932:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1788463452.221080:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788463452.221191:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485808128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788463452.221256:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.221304:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463452.225143:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485808128 00000100:00100000:0.0:1788463452.225163:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485808128 00000100:00100000:0.0:1788463452.225259:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788463452.225270:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485808128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788463452.225429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485808128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 160us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.225441:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788463452.225635:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485808128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788463452.225834:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788463452.226167:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485808256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788463452.226217:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.226249:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc27600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.226392:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485808256 00000100:00100000:1.0:1788463452.226399:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485808256 00000100:00100000:1.0:1788463452.226495:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788463452.226514:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1875339485808256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788463452.226708:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6526:x1875339485808256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (490us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788463452.226715:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788463452.226800:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178847bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875339485808256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788463452.226860:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788463452.226908:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.226920:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.226941:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.226947:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdee00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463452.226953:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.226962:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.226984:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:2.0:1788463452.226987:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788463452.226993:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.227000:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdee00/0x841acb7f42a3a5ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463452.227123:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788463452.227211:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788463452.227225:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 491678649976ns, next at 492678646776ns, rc = 0 00000001:00080000:2.0:1788463452.227232:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788463452.227255:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655f00) 00010000:00010000:2.0:1788463452.227258:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463452.227266:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a5ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a08 expref: 55 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.227392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961886cfec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+54:12453:x1875339466869376:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 17973us (18282us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788463452.227401:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000020:00080000:2.0:1788463452.227405:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788463452.230932:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.231135:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466869632 00000100:00100000:2.0:1788463452.231154:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466869632 00000100:00100000:2.0:1788463452.231242:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 219 00000100:00100000:2.0:1788463452.231258:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+54:12453:x1875339466869632:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463452.231290:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.231326:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a606 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a0f expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.231405:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a606 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a0f expref: 55 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.231422:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a606 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a0f expref: 55 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.231443:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.231447:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463452.231470:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20600, rc 0) 00000100:00100000:2.0:1788463452.231761:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+55:12453:x1875339466869632:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 323us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.231771:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 219 00000100:00100000:0.0:1788463452.236085:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.236240:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466869888 00000100:00100000:3.0:1788463452.236250:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466869888 00000100:00100000:3.0:1788463452.236303:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463452.236313:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+55:12453:x1875339466869888:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463452.236696:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+56:12453:x1875339466869888:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 383us (620us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788463452.236704:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463452.365914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.366355:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466870016 00000100:00100000:0.0:1788463452.366366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466870016 00000100:00100000:0.0:1788463452.366435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 220 00000100:00100000:0.0:1788463452.366445:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+56:12463:x1875339466870016:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:0.0:1788463452.366539:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366559:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366598:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366611:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366618:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366625:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366696:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366725:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366732:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463452.366782:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366795:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366802:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366808:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366814:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463452.366818:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366826:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366839:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463452.366842:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463452.366846:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366853:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a60d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366872:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366878:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366883:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366888:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463452.366906:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366913:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366932:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:0.0:1788463452.366935:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463452.366939:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366945:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1800/0x841acb7f42a3a614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366955:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366961:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366967:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366976:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463452.366980:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366985:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.366993:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:0.0:1788463452.366995:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463452.366998:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.367004:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0200/0x841acb7f42a3a61b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463452.367086:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+56:12463:x1875339466870016:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 642us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.367095:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 220 00000100:00100000:0.0:1788463452.454327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.454474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466870272 00000100:00100000:2.0:1788463452.454497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466870272 00000100:00100000:2.0:1788463452.454563:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 221 00000100:00100000:2.0:1788463452.454609:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+56:12466:x1875339466870272:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463452.454631:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.454655:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a16 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454736:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454752:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454764:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454774:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454782:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454788:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454943:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a637 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454957:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.454964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a637 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463452.454975:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788463452.455053:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455061:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455068:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455073:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463452.455078:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455086:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455098:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463452.455101:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463452.455106:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20000/0x841acb7f42a3a629 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455127:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455139:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455144:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455149:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463452.455152:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455157:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455165:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:2.0:1788463452.455168:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463452.455171:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455177:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20200/0x841acb7f42a3a630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455233:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21c00/0x841acb7f42a3a622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a16 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455248:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a637 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a16 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.455256:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.455258:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463452.455266:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27200, rc 0) 00000100:00100000:2.0:1788463452.455342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+58:12466:x1875339466870272:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 769us (1024us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788463452.455350:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 221 00000100:00100000:3.0:1788463452.464886:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.470232:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466870400 00000100:00100000:2.0:1788463452.470249:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466870400 00000100:00100000:2.0:1788463452.470408:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 222 00000100:00100000:2.0:1788463452.470421:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+58:12466:x1875339466870400:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:2.0:1788463452.470490:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470507:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470518:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470563:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470570:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470594:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470599:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463452.470603:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470610:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470636:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.470639:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463452.470644:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.470651:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.470743:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+58:12466:x1875339466870400:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 324us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.470751:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 222 00000100:00100000:1.0:1788463452.476908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.477012:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466870656 00000100:00100000:3.0:1788463452.477022:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466870656 00000100:00100000:3.0:1788463452.477084:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:3.0:1788463452.477096:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+58:12466:x1875339466870656:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463452.477363:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+59:12466:x1875339466870656:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 269us (466us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788463452.477372:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:1.0:1788463452.548206:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463452.548242:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485808384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463452.548314:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.548663:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485808384 00000100:00100000:2.0:1788463452.548672:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485808384 00000100:00100000:2.0:1788463452.548732:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788463452.548743:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485808384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463452.548779:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788463452.548836:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485808384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.548843:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788463452.549082:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485808384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463452.653004:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.653648:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466870912 00000100:00100000:2.0:1788463452.653660:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466870912 00000100:00100000:2.0:1788463452.653747:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 223 00000100:00100000:2.0:1788463452.653757:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+59:12475:x1875339466870912:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463452.653791:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.653795:0:12162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788463452.653822:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20800/0x841acb7f42a3a5c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769fa expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.653861:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463452.653866:0:12162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463452.653883:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a64c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a1d expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.654014:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3a653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.654028:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3a653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.654038:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3a653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463452.654048:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788463452.654163:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a64c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a1d expref: 61 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.654177:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3a653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a1d expref: 60 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.654185:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.654188:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463452.654190:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27c00, rc 0) 00000100:00100000:2.0:1788463452.655455:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+60:12475:x1875339466870912:12345-192.168.204.53@tcp:101:bash.0 Request processed in 1692us (2455us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788463452.655465:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 223 00000100:00100000:1.0:1788463452.676425:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463452.676468:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.676558:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871168 00000100:00100000:0.0:1788463452.676568:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871168 00000100:00100000:0.0:1788463452.676657:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:0.0:1788463452.676676:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+60:2400:x1875339466871168:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463452.676693:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463452.676721:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27c00/0x841acb7f42a3a653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a1d expref: 60 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.676744:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:0.0:1788463452.676764:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463452.676820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+59:2400:x1875339466871168:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 145us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.676828:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:3.0:1788463452.678200:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871040 00000100:00100000:3.0:1788463452.678220:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871040 00000100:00100000:3.0:1788463452.678274:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 224 00000100:00100000:3.0:1788463452.678284:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+59:12475:x1875339466871040:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463452.678307:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.678326:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a661 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a24 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678364:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678390:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678401:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678514:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678970:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.678986:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463452.678989:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463452.678992:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:3.0:1788463452.679046:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+60:12475:x1875339466871040:12345-192.168.204.53@tcp:101:bash.0 Request processed in 763us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.679053:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 224 00000100:00100000:1.0:1788463452.683690:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.683871:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871424 00000100:00100000:2.0:1788463452.683883:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871424 00000100:00100000:2.0:1788463452.683955:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 225 00000100:00100000:2.0:1788463452.683967:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+60:12475:x1875339466871424:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:2.0:1788463452.684027:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463452.684057:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a16 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.684078:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.684084:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463452.684274:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.684288:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.684298:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463452.684343:0:10067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:2.0:1788463452.684366:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080a2f57d reply state 00000000bea63c97 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.684378:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.684385:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.684387:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463452.684390:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463452.684478:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+62:12475:x1875339466871424:12345-192.168.204.53@tcp:36:bash.0 Request processed in 513us (799us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788463452.684498:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 225 00000020:00080000:2.0:1788463452.684503:0:10067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788463452.691077:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.691240:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871552 00000100:00100000:3.0:1788463452.691252:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871552 00000100:00100000:3.0:1788463452.691318:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 226 00000100:00100000:3.0:1788463452.691329:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+62:12475:x1875339466871552:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463452.691351:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.691373:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a676 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a2b expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691464:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691479:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691489:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463452.691518:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788463452.691522:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463452.691540:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691635:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a676 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 64 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691655:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 63 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.691978:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463452.691981:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463452.691985:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde200, rc 0) 00000100:00100000:3.0:1788463452.692088:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+63:12475:x1875339466871552:12345-192.168.204.53@tcp:101:bash.0 Request processed in 759us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.692094:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 226 00000100:00100000:1.0:1788463452.704640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.704901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871808 00000100:00100000:3.0:1788463452.704922:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871808 00000100:00100000:3.0:1788463452.704984:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:3.0:1788463452.704995:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+63:12475:x1875339466871808:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:3.0:1788463452.705226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+64:12475:x1875339466871808:12345-192.168.204.53@tcp:35:bash.0 Request processed in 232us (595us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788463452.705235:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00010000:00010000:3.0:1788463452.803813:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463452.884645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.885028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466871936 00000100:00100000:0.0:1788463452.885053:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466871936 00000100:00100000:0.0:1788463452.885120:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 227 00000100:00100000:0.0:1788463452.885131:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+64:12482:x1875339466871936:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463452.885157:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463452.885180:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a684 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a32 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885564:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885610:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885624:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463452.885666:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788463452.885670:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463452.885689:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885714:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a684 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a32 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885731:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a32 expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.885754:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463452.885757:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463452.885761:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1c00, rc 0) 00000100:00100000:0.0:1788463452.885875:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466871936:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 746us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.885882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 227 00000100:00100000:1.0:1788463452.900735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.901033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872064 00000100:00100000:0.0:1788463452.901043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872064 00000100:00100000:0.0:1788463452.901108:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 228 00000100:00100000:0.0:1788463452.901118:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466872064:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463452.901150:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463452.901171:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a39 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901236:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901251:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901263:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901274:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901282:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901309:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901385:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901394:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463452.901448:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788463452.901452:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463452.901939:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901952:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901959:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901966:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901973:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901979:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463452.901982:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.901999:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902011:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:0.0:1788463452.902014:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463452.902018:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902024:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0a00/0x841acb7f42a3a699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902037:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902042:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902047:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902051:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463452.902053:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902058:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902064:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:0.0:1788463452.902066:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463452.902069:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902085:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1a00/0x841acb7f42a3a6a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902114:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1600/0x841acb7f42a3a692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902128:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.902192:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:0.0:1788463452.902196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463452.902198:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1000, rc 0) 00000100:00100000:0.0:1788463452.902321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+66:12482:x1875339466872064:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1202us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.902329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 228 00000100:00100000:1.0:1788463452.909086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463452.909193:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872320 00000100:00100000:3.0:1788463452.909260:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872320 00000100:00100000:3.0:1788463452.910973:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 229 00000100:00100000:3.0:1788463452.910990:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+66:12482:x1875339466872320:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463452.911012:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.911054:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a6ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a40 expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911186:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911201:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 67 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911221:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911229:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911265:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.911347:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 67 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.911364:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485808512:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463452.912434:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 67 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.912450:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 67 pid: 12162 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.912462:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485808640:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463452.915499:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.915542:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.922194:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872448 00000100:00100000:2.0:1788463452.922224:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872448 00010000:00010000:2.0:1788463452.922290:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 68 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.922327:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 100 00000100:00100000:2.0:1788463452.922339:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+68:2402:x1875339466872448:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463452.922355:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463452.922362:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 68 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.922389:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 68 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.922414:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.922419:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.922428:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.922434:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463452.922492:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+68:2402:x1875339466872448:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 155us (6955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.922501:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485808640:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463452.922502:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 100 00000100:00100000:1.0:1788463452.925521:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.925651:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872576 00000100:00100000:2.0:1788463452.925662:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872576 00010000:00010000:2.0:1788463452.925704:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 68 pid: 12162 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.925750:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 101 00000100:00100000:2.0:1788463452.925759:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+68:2403:x1875339466872576:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463452.925774:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463452.925781:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 68 pid: 12162 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925795:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 68 pid: 12162 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925818:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde200/0x841acb7f42a3a67d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a2b expref: 68 pid: 12162 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925837:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.925842:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925853:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925861:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.925883:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463452.925945:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+67:2403:x1875339466872576:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 187us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.925969:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 101 00010000:00010000:3.0:1788463452.926331:0:12162:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.53@tcp) returned -22 from blocking AST (req@0000000029315005 x1875339485808512) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 66 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.926346:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a6a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a39 expref: 66 pid: 6522 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463452.926356:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485808512:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463452.926616:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463452.926625:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.926637:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.926644:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463452.926668:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788463452.926816:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a6ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 67 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.926833:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 66 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.926839:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463452.926849:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463452.926852:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf200, rc 0) 00000100:00100000:3.0:1788463452.926886:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+66:12482:x1875339466872320:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 15903us (17811us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788463452.926894:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 229 00000100:00100000:1.0:1788463452.943061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.943176:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872832 00000100:00100000:2.0:1788463452.943187:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872832 00000100:00100000:2.0:1788463452.943281:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:2.0:1788463452.943292:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+66:12482:x1875339466872832:12345-192.168.204.53@tcp:103:lfs.0 00010000:00010000:2.0:1788463452.943311:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463452.943341:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20600/0x841acb7f42a3a606 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a0f expref: 66 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.943362:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.943368:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463452.943432:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466872832:12345-192.168.204.53@tcp:103:lfs.0 Request processed in 142us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.943439:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463452.946835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463452.947195:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466872960 00000100:00100000:2.0:1788463452.947218:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466872960 00000100:00100000:2.0:1788463452.947473:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 230 00000100:00100000:2.0:1788463452.947485:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466872960:12345-192.168.204.53@tcp:58:lfs.0 00010000:00010000:2.0:1788463452.947821:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.947840:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.947853:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463452.947991:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788463452.948113:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466872960:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 630us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.948121:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 230 00000100:00100000:1.0:1788463452.958265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463452.960218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873088 00000100:00100000:0.0:1788463452.960239:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873088 00000100:00100000:2.0:1788463452.961318:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 231 00000100:00100000:2.0:1788463452.961331:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+65:12482:x1875339466873088:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463452.961357:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463452.961386:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a47 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961445:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961457:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961479:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961492:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961507:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463452.961510:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463452.961525:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.961825:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27000, rc 0) 00000100:00100000:2.0:1788463452.961897:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+66:12482:x1875339466873088:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 568us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.961907:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 231 00000001:00080000:0.0:1788463453.573469:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788463453.573484:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:1.0:1788463453.829974:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463453.892355:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463453.892364:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463453.892391:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788463453.892403:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463453.892535:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485808768:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463453.892684:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463453.898293:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463453.898532:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873216 00000100:00100000:3.0:1788463453.898546:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873216 00000100:00100000:3.0:1788463453.898677:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 232 00000100:00100000:3.0:1788463453.898690:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873216:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463453.898734:0:12162:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463453.899048:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873216:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 360us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463453.899057:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 232 00000100:00100000:0.0:1788463453.900172:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485808768:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463453.920019:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463453.920219:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873344 00000100:00100000:2.0:1788463453.920230:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873344 00000100:00100000:2.0:1788463453.920292:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 233 00000100:00100000:2.0:1788463453.920303:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+66:12483:x1875339466873344:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788463453.920381:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920400:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920414:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920430:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920437:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920445:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920468:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920499:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920506:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463453.920555:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788463453.920560:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463453.920607:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920620:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920627:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920633:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920640:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463453.920644:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920652:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920663:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463453.920666:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463453.920670:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920686:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a6d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920700:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920705:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920711:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920716:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463453.920719:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920726:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920734:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff961894655f00) 00010000:00010000:2.0:1788463453.920737:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463453.920740:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920747:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920762:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920963:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920976:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920983:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463453.920987:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.920994:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.921003:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463453.921005:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463453.921008:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.921014:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463453.921276:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+66:12483:x1875339466873344:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 972us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463453.921286:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 233 00000100:00100000:1.0:1788463453.938750:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463453.939083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873600 00000100:00100000:2.0:1788463453.939102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873600 00000100:00100000:2.0:1788463453.939192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 234 00000100:00100000:2.0:1788463453.939205:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+66:12483:x1875339466873600:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463453.939237:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463453.939262:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a4e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939399:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939416:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939428:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463453.939440:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788463453.939520:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939529:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939535:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939541:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463453.939545:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939552:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939565:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463453.939568:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463453.939609:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939627:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a6ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939674:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a4e expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939684:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463453.939687:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463453.939691:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a4e expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.939700:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27a00, rc 0) 00000100:00100000:2.0:1788463453.939776:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873600:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 574us (1054us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1788463453.939783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 234 00000100:00100000:0.0:1788463453.950846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463453.951564:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873728 00000100:00100000:3.0:1788463453.951629:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873728 00000100:00100000:2.0:1788463453.953190:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 235 00000100:00100000:2.0:1788463453.953205:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873728:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463453.953244:0:12162:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463453.953381:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873728:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 179us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463453.953388:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 235 00000100:00100000:3.0:1788463453.963420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463453.963691:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466873984 00000100:00100000:2.0:1788463453.963705:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466873984 00000100:00100000:2.0:1788463453.963810:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 236 00000100:00100000:2.0:1788463453.963824:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466873984:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463453.963873:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463453.963877:0:10067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788463453.963927:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1c00/0x841acb7f42a3a68b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a32 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.963954:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463453.963962:0:10067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463453.963981:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a55 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463453.971103:0:10067:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788463453.971400:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.971428:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.971445:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.971546:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a6fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a55 expref: 69 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.971572:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a55 expref: 68 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463453.971606:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961894655f00) 00010000:00010000:2.0:1788463453.971610:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463453.971634:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26200, rc 0) 00000100:00100000:2.0:1788463453.971748:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+68:12483:x1875339466873984:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 7926us (8343us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788463453.971759:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 236 00000100:00100000:1.0:1788463453.988904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463453.989079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466874240 00000100:00100000:3.0:1788463453.989096:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466874240 00000100:00100000:3.0:1788463453.989175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 237 00000100:00100000:3.0:1788463453.989197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+68:12483:x1875339466874240:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463453.989279:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463453.989313:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26200/0x841acb7f42a3a702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a55 expref: 68 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989338:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961894655f00) 00010000:00010000:3.0:1788463453.989355:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463453.989393:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989429:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989441:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989461:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989468:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989474:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989536:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989543:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989551:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989557:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463453.989563:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989642:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989654:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463453.989664:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463453.989670:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989678:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a710 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989690:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989696:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989703:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989709:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdea00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463453.989712:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989718:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.989726:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbce794b4 (ffff961885469200) 00010000:00010000:3.0:1788463453.989729:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463453.989732:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463453.990470:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a717 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbce794b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463453.991177:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466874240:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 1982us (2289us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463453.991188:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 237 00000100:00100000:0.0:1788463454.004733:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.005146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466874368 00000100:00100000:3.0:1788463454.005487:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466874368 00000100:00100000:3.0:1788463454.005658:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 238 00000100:00100000:3.0:1788463454.005674:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+67:12483:x1875339466874368:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463454.005704:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463454.005874:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a71e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a5c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.005937:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.005956:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.005971:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.006116:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a71e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463454.006390:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463454.006485:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.006495:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:3.0:1788463454.006499:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463454.006503:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdea00, rc 0) 00000100:00100000:3.0:1788463454.011662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+68:12483:x1875339466874368:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 3494us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463454.011693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 238 00000100:00100000:1.0:1788463454.015335:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.015479:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466874624 00000100:00100000:2.0:1788463454.015492:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466874624 00000100:00100000:2.0:1788463454.015608:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 239 00000100:00100000:2.0:1788463454.015622:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+68:12483:x1875339466874624:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.015749:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.015776:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.015790:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463454.016161:0:10067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788463454.016171:0:10067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 493467595921ns, next at 494467593013ns, rc = 0 00000004:00010000:2.0:1788463454.016243:0:10067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5907d6f reply state 00000000397870ad transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.016258:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.016267:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.016291:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788463454.016295:0:10067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463454.016548:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+70:12483:x1875339466874624:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 928us (1382us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788463454.016555:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 239 00000100:00100000:1.0:1788463454.019562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.020643:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466874752 00000100:00100000:2.0:1788463454.020661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466874752 00000100:00100000:2.0:1788463454.020761:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 240 00000100:00100000:2.0:1788463454.020775:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+70:12483:x1875339466874752:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.020813:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463454.020844:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a63 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.021120:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.021142:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.021168:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.021521:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463454.021527:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27800, rc 0) 00000100:00100000:2.0:1788463454.021767:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+71:12483:x1875339466874752:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 994us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.021776:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 240 00000100:00100000:0.0:1788463454.028504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.030684:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466874880 00000100:00100000:1.0:1788463454.030708:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466874880 00000100:00100000:1.0:1788463454.030818:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:1.0:1788463454.030837:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2400:x1875339466874880:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788463454.031154:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+10:2400:x1875339466874880:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 324us (2665us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788463454.031163:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00080000:0.0:1788463454.031502:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463454.043300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.043447:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466875136 00000100:00100000:3.0:1788463454.043478:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466875136 00000100:00100000:3.0:1788463454.043554:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:3.0:1788463454.043566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+71:12483:x1875339466875136:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788463454.044011:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+72:12483:x1875339466875136:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 444us (725us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788463454.044021:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:3.0:1788463454.048033:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.048345:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466875392 00000100:00100000:2.0:1788463454.048431:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466875392 00000100:00100000:2.0:1788463454.048557:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 241 00000100:00100000:2.0:1788463454.048633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+72:12483:x1875339466875392:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463454.048794:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+72:12483:x1875339466875392:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 166us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.048804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 241 00000100:00100000:1.0:1788463454.051992:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463454.053078:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466875520 00000100:00100000:0.0:1788463454.053096:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466875520 00000100:00100000:1.0:1788463454.053618:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 242 00000100:00100000:1.0:1788463454.053636:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+72:12483:x1875339466875520:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463454.053686:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463454.053715:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a73a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a6a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.053817:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.053836:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.053851:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463454.053937:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463454.053961:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.053992:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a73a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a6a expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.054011:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a6a expref: 73 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.054021:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:1.0:1788463454.054024:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463454.054027:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463454.054112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+73:12483:x1875339466875520:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 484us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463454.054121:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 242 00000100:00100000:1.0:1788463454.057843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463454.057943:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466875648 00000100:00100000:0.0:1788463454.057958:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466875648 00000100:00100000:0.0:1788463454.058038:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:0.0:1788463454.058051:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+10:2401:x1875339466875648:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463454.058075:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463454.058102:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a71 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463454.058149:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c95e, blocks: 0x0 00010000:00010000:0.0:1788463454.060613:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1788463454.060633:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463454.060654:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.060690:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.060710:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1000, rc 0) 00000100:00100000:0.0:1788463454.060819:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68497686-852f-43ff-8be6-586d5980ece4+11:2401:x1875339466875648:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 2770us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.060851:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:1.0:1788463454.064035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.064635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466875904 00000100:00100000:3.0:1788463454.064649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466875904 00000100:00100000:3.0:1788463454.064731:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 243 00000100:00100000:3.0:1788463454.064743:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+73:12483:x1875339466875904:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788463454.064904:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+73:12483:x1875339466875904:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 163us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463454.064914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 243 00000100:00100000:1.0:1788463454.069116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.069370:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876032 00000100:00100000:2.0:1788463454.069384:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876032 00000100:00100000:2.0:1788463454.069462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:2.0:1788463454.069475:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+11:12483:x1875339466876032:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.069499:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463454.069523:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a78 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.069566:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.069608:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463454.069613:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463454.069619:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.069664:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.069680:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.069720:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875339485808896:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463454.069835:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.072667:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875339485808896:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.072726:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.072755:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26c00, rc 0) 00000100:00100000:2.0:1788463454.072839:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+12:12483:x1875339466876032:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 3366us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.072850:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:3.0:1788463454.076433:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.077094:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876160 00000100:00100000:2.0:1788463454.077121:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876160 00010000:00010000:2.0:1788463454.077205:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.077261:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:2.0:1788463454.077274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+12:2400:x1875339466876160:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463454.077295:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.077325:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.077342:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.077410:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3a748 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a71 expref: 12 pid: 8441 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.077434:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463454.077439:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463454.077451:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.077462:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.077512:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 11 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.077530:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875339485809024:192.168.204.53@tcp:105: 00000100:00100000:2.0:1788463454.077707:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.085823:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875339485809024:192.168.204.53@tcp:105: 00010000:00010000:2.0:1788463454.085863:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463454.085948:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+11:2400:x1875339466876160:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 8674us (9530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.085960:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 102 00000100:00100000:0.0:1788463454.091955:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.092093:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876288 00000100:00100000:3.0:1788463454.092107:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876288 00002000:00100000:3.0:1788463454.092203:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff961787148000 x1875339466876288/t0(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:590/0 lens 504/0 e 0 to 0 dl 1788463465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463454.092216:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961787148000 with x1875339466876288 ext(0->12) 00002000:00010000:3.0:1788463454.092224:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961787148000 00000100:00100000:3.0:1788463454.092259:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:3.0:1788463454.092271:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+11:2401:x1875339466876288:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788463454.097689:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:68497686-852f-43ff-8be6-586d5980ece4+13:2401:x1875339466876288:12345-192.168.204.53@tcp:4:lhsmtool_posix.0 Request processed in 5402us (5733us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788463454.097707:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00002000:00100000:2.0:1788463454.097743:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff961787148000 x1875339466876288/t4294967321(0) o4->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:590/0 lens 504/448 e 0 to 0 dl 1788463465 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788463454.097755:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff961787148000 with x1875339466876288 ext(0->12) 00002000:00010000:2.0:1788463454.097764:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff961787148000 00000100:00100000:0.0:1788463454.107513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.107665:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876416 00000100:00100000:2.0:1788463454.107680:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876416 00000100:00100000:2.0:1788463454.107764:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 244 00000100:00100000:2.0:1788463454.107778:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+73:12483:x1875339466876416:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788463454.113674:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788463454.113692:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788463454.113738:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788463454.113759:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff96188fc27000 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:2.0:1788463454.113770:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463454.113778:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9618828f2400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff96188fc27300 00000020:00080000:1.0:1788463454.113794:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff96188d152f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9618c1b17000 00010000:00010000:2.0:1788463454.113806:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.113818:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.113826:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdec00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.113834:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463454.113841:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:2.0:1788463454.113843:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.113876:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff961787b9a000) 00000020:00080000:1.0:1788463454.113878:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9618b7c200c0 refcount 2 committed 0 result 0 batchid 6 00010000:00010000:2.0:1788463454.113881:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788463454.113894:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961883d30300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9618b7c20f00 00000020:00080000:1.0:1788463454.113899:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961883d30a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96178849ca00 00000020:00080000:1.0:1788463454.113925:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788463454.114003:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788463454.114480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485809152:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788463454.114640:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114650:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3a454 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.114687:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463454.114730:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.114767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463454.114788:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485809280:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788463454.114814:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.114814:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463454.114827:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114834:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.114839:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114847:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114862:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff961884f9d200) 00010000:00010000:2.0:1788463454.114866:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463454.114869:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114875:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21a00/0x841acb7f42a3a4fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.114903:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.115190:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463454.115208:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485809408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463454.115286:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463454.115372:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485809152 00000100:00100000:0.0:1788463454.115382:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485809152 00000100:00100000:0.0:1788463454.115449:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485809280 00000100:00100000:0.0:1788463454.115452:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485809280 00000100:00100000:0.0:1788463454.115462:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485809408 00000100:00100000:0.0:1788463454.115465:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485809408 00000100:00100000:0.0:1788463454.115481:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463454.115490:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3648:x1875339485809152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788463454.115623:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788463454.115651:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.115674:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.115682:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788463454.115687:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463454.115692:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.115725:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 12 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.115738:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 12 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.115765:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485809536:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.115861:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116111:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.116210:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788463454.116228:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875339485809280:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788463454.116416:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.116424:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116435:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116453:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:2.0:1788463454.116457:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463454.116462:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116470:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0e00/0x841acb7f42a3a57a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116494:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116501:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116508:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116513:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.116516:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116522:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116540:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961884f9bf00) 00010000:00010000:2.0:1788463454.116543:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463454.116546:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116553:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20400/0x841acb7f42a3a59d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116572:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116603:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116609:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116614:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.116618:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116624:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116632:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463454.116634:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463454.116637:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116643:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a66f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116666:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116673:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116679:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116685:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.116688:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116695:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116703:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.116706:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463454.116709:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.116715:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a72c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463454.117315:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788463454.117320:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788463454 00002000:00010000:3.0:1788463454.117323:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463454.117325:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788463454 -> 1788463454 00002000:00010000:3.0:1788463454.117327:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:1.0:1788463454.118114:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463454.118124:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788463454.120932:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96178714a300/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788463454.120960:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178714a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485809280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463454.127550:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+21:12483:x1875339466876416:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 19753us (20033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.127604:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 244 00000100:00100000:0.0:1788463454.127604:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463454.128906:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1875339485809280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 12666us (14072us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788463454.129120:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788463454.132652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788463454.132685:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485809408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788463454.132730:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788463454.132796:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a99c95c, atime: 0x6a99c95c, ctime: 0x6a99c95c, blocks: 0x8 00010000:00010000:3.0:1788463454.132808:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.132831:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=493s v=(0 0) 00010000:00010000:3.0:1788463454.132836:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463454.132845:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.132866:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.133139:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.133150:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.133193:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463454.133255:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463454.133283:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.133298:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463454.133305:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.133318:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.133343:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.133350:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078306a56/0x841acb7f42a3a75d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.133489:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fe1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485809408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 816us (18201us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788463454.133500:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788463454.133620:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463454.133623:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463454.133625:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463454.134220:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788463454.134229:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:1.0:1788463454.134285:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96188f9e2680, transno 4294967308 00000004:00080000:1.0:1788463454.134304:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:1.0:1788463454.134330:0:3651:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff96188cf33480 x1875339485809408/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788463470 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788463454.134353:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96188cf33480/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788463454.134359:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485809408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788463454.140226:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.140312:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8441:1875339485809536:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.140355:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.140449:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876544 00000100:00100000:1.0:1788463454.140459:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876544 00010000:00010000:1.0:1788463454.140510:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 13 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.140560:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 103 00000100:00100000:1.0:1788463454.140570:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+13:2400:x1875339466876544:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463454.140636:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463454.140643:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 13 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.140659:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 13 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.140687:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d7ede64/0x841acb7f42a3a50a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769d0 expref: 13 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.140708:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463454.140713:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463454.140720:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.140751:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.140783:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463454.140840:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+12:2400:x1875339466876544:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 270us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463454.140848:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 103 00010000:00010000:0.0:1788463454.141289:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.141314:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.141326:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.141335:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.141372:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788463454.141640:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875339485809152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26150us (26955us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788463454.141649:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1788463454.141930:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961787148a80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788463454.141948:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485809152:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788463454.143405:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463454.143424:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.143450:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463454.143456:0:8455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.143469:0:8455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.143496:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.143505:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d89770/0x841acb7f42a3a756 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.143536:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463454.143558:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463454.143560:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463454.151977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.152153:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876672 00000100:00100000:2.0:1788463454.152168:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876672 00000100:00100000:2.0:1788463454.152245:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:2.0:1788463454.152257:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+12:2401:x1875339466876672:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788463454.160706:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788463454.160749:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788463454.161822:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466876672:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 9552us (9844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.161840:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:3.0:1788463454.171229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.171867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466876928 00000100:00100000:2.0:1788463454.171881:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466876928 00000100:00100000:2.0:1788463454.171997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:2.0:1788463454.172010:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+21:12483:x1875339466876928:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.172092:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.172147:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a6a expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.172379:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.172389:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463454.172435:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.172454:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.172467:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463454.172961:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9ca3c84 reply state 0000000006633bc8 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.172977:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.172985:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.172988:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463454.172993:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463454.174658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+22:12483:x1875339466876928:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 2637us (3435us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788463454.174672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 245 00000100:00100000:0.0:1788463454.179863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.180144:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877056 00000100:00100000:3.0:1788463454.180160:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877056 00000100:00100000:3.0:1788463454.180255:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:3.0:1788463454.180267:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2403:x1875339466877056:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788463454.181018:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788463454.181024:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788463454 -> 1788463453 00002000:00010000:2.0:1788463454.181027:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788463452 00002000:00010000:2.0:1788463454.181030:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788463454 -> 1788463453 00002000:00010000:2.0:1788463454.181032:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788463454.181119:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2403:x1875339466877056:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 852us (1271us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788463454.181128:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 77 00000100:00100000:0.0:1788463454.184013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.184188:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877312 00000100:00100000:2.0:1788463454.184201:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877312 00000100:00100000:2.0:1788463454.184278:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:2.0:1788463454.184289:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+22:12483:x1875339466877312:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.184402:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.184448:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.184461:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.184510:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.184526:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 22 pid: 6524 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.184543:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485809664:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463454.184909:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.190214:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485809664:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.190264:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.197679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.203627:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877440 00000100:00100000:2.0:1788463454.203654:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877440 00010000:00010000:2.0:1788463454.204543:0:6552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 23 pid: 6524 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.204642:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00100000:2.0:1788463454.204664:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+23:2402:x1875339466877440:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463454.204691:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.204718:0:6552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 23 pid: 6524 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.204807:0:6552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 23 pid: 6524 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.204842:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a5c expref: 23 pid: 6524 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.204867:0:6552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.204873:0:6552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.204895:0:6552:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.204905:0:6552:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.205119:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463454.205335:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205355:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205412:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205433:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205440:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205447:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463454.205452:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205462:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205472:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:0.0:1788463454.205475:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788463454.205479:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.205486:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26400/0x841acb7f42a3a76b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.205643:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+22:12483:x1875339466877312:12345-192.168.204.53@tcp:55:lhsmtool_posix.0 Request processed in 21353us (21641us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788463454.205654:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 246 00000100:00100000:2.0:1788463454.209509:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:68497686-852f-43ff-8be6-586d5980ece4+21:2402:x1875339466877440:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 4836us (11828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.209529:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 104 00000100:00100000:0.0:1788463454.211507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.214447:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877568 00000100:00100000:2.0:1788463454.214472:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877568 00000100:00100000:2.0:1788463454.214556:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:2.0:1788463454.214569:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2402:x1875339466877568:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.214658:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.214715:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.214726:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463454.214743:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463454.214751:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.214801:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.214818:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 8 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.214836:0:8440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875339485809792:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463454.215222:0:8440:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.223426:0:8440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8440:1875339485809792:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.223477:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.224381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.224615:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877696 00000100:00100000:2.0:1788463454.224626:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877696 00010000:00010000:2.0:1788463454.224681:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 9 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.224759:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 105 00000100:00100000:2.0:1788463454.224771:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+9:2401:x1875339466877696:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463454.224792:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.224822:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 9 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.224837:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 9 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.224864:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3a74f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a78 expref: 9 pid: 8440 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.224894:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463454.224899:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463454.224906:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.224917:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.224956:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463454.225028:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466877696:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 259us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.225036:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 105 00010000:00010000:0.0:1788463454.225277:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225290:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225325:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225334:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225344:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225351:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463454.225357:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225368:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225381:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.225389:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087ef24de/0x841acb7f42a3a772 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.225444:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466877568:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 10877us (13948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.225452:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 78 00000100:00100000:0.0:1788463454.230004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.231410:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466877952 00000100:00100000:2.0:1788463454.231429:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466877952 00000100:00100000:2.0:1788463454.231546:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 247 00000100:00100000:2.0:1788463454.231560:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+21:12483:x1875339466877952:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.231692:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.231715:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.231727:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.231779:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.231799:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 21 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.231817:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485809920:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463454.231963:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786b21600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.234294:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485809920:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.234343:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.240366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.240870:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878080 00000100:00100000:2.0:1788463454.240895:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878080 00010000:00010000:2.0:1788463454.240959:0:9527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.241028:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 106 00000100:00100000:2.0:1788463454.241040:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+22:2401:x1875339466878080:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463454.241061:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.241069:0:9527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241084:0:9527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241111:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a24 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241133:0:9527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463454.241140:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241151:0:9527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241160:0:9527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241168:0:9527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.241207:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463454.241281:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:68497686-852f-43ff-8be6-586d5980ece4+21:2401:x1875339466878080:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 244us (938us total) trans 0 rc 0/0 00010000:00010000:3.0:1788463454.241293:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.241298:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 106 00010000:00010000:3.0:1788463454.241308:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.241547:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.241560:0:12162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.241624:0:12162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.241663:0:12162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.241680:0:12162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 21 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.241696:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485810048:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463454.242267:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.252052:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485810048:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463454.252097:0:12162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.254186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.254467:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878208 00000100:00100000:2.0:1788463454.254483:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878208 00010000:00010000:2.0:1788463454.254543:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.254617:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 107 00000100:00100000:2.0:1788463454.254642:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+22:2400:x1875339466878208:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463454.254665:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463454.254672:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254686:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254715:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27800/0x841acb7f42a3a733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a63 expref: 22 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254734:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:2.0:1788463454.254740:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254752:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254782:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.254816:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463454.254903:0:12162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.254903:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cda050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68497686-852f-43ff-8be6-586d5980ece4+21:2400:x1875339466878208:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 274us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.254912:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 107 00010000:00010000:3.0:1788463454.254932:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463454.255126:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788463454.256726:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1788463454.256800:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788463454.257309:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485810176:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788463454.257463:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463454.257593:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463454.261832:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485810176 00000100:00100000:1.0:1788463454.261863:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485810176 00000100:00100000:1.0:1788463454.262290:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788463454.262313:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485810176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788463454.262784:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485810176:12345-0@lo:1000:mdt00_004.0 Request processed in 481us (5320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463454.262794:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788463454.264064:0:12162:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788463454.264078:0:12162:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1788463454.264107:0:12162:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96178714a300, transno 4294967322 00000004:00080000:3.0:1788463454.264117:0:12162:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff961787148a80, transno 4294967323 00000100:00100000:3.0:1788463454.264410:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485810176:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788463454.274984:0:12162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1788463454.275088:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485810304:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788463454.275195:0:12162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463454.275258:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463454.275387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485810304 00000100:00100000:0.0:1788463454.275399:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485810304 00000100:00100000:0.0:1788463454.275467:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788463454.275478:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12162:x1875339485810304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788463454.275715:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12162:x1875339485810304:12345-0@lo:1000:mdt00_004.0 Request processed in 238us (519us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788463454.275724:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788463454.276301:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12162:1875339485810304:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788463454.276465:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276478:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276487:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276494:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463454.276499:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276509:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276531:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:3.0:1788463454.276535:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463454.276541:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276548:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3a780 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276629:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276659:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276666:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276671:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463454.276675:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276681:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276691:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463454.276694:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463454.276703:0:12162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276716:0:12162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276727:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.276770:0:12162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.276784:0:12162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485810432:192.168.204.53@tcp:105: 00000100:00100000:3.0:1788463454.276903:0:12162:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463454.281347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.281508:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878336 00000100:00100000:2.0:1788463454.281521:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878336 00000100:00100000:2.0:1788463454.281643:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:2.0:1788463454.281656:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+25:12482:x1875339466878336:12345-192.168.204.53@tcp:49:lfs.0 00000100:00100000:2.0:1788463454.281825:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+25:12482:x1875339466878336:12345-192.168.204.53@tcp:49:lfs.0 Request processed in 172us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.281833:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:3.0:1788463454.291249:0:12162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12162:1875339485810432:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463454.291302:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.291318:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27200/0x841acb7f42a3a6c3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.291925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.297778:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878592 00000100:00100000:1.0:1788463454.297804:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878592 00000100:00100000:1.0:1788463454.297907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 248 00000100:00100000:1.0:1788463454.297924:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+25:12482:x1875339466878592:12345-192.168.204.53@tcp:58:lfs.0 00000040:00080000:1.0:1788463454.298265:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788463454.298396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+25:12482:x1875339466878592:12345-192.168.204.53@tcp:58:lfs.0 Request processed in 475us (6473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463454.298405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 248 00010000:00010000:2.0:1788463454.299169:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299196:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299210:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299224:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299231:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299259:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299265:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.299270:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299278:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299292:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463454.299295:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463454.299300:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299307:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a787 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299323:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299329:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299335:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299339:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.299458:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299475:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299484:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463454.299486:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463454.299490:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.299495:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a779 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463454.299789:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+24:12483:x1875339466877952:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 68228us (69796us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788463454.299798:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 247 00000020:00080000:2.0:1788463454.299804:0:12162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788463454.309983:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463454.309998:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463454.310061:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788463454.310070:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463454.310287:0:13808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485810560:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463454.310412:0:13808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b43bbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.322224:0:13808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1875339485810560:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463454.325471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.325625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878848 00000100:00100000:2.0:1788463454.325639:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878848 00000100:00100000:2.0:1788463454.325732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:2.0:1788463454.325747:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961886cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+24:12483:x1875339466878848:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788463454.326126:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788463454.326205:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1788463454.326251:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326274:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326289:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326300:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326308:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326315:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.326338:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463454.326465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961886cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+26:12483:x1875339466878848:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 720us (1006us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788463454.326474:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00000020:00080000:2.0:1788463454.326482:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463454.326755:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463454.326764:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.326772:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463454.326776:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.326786:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.326800:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:0.0:1788463454.326803:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463454.326809:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.326815:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26a00/0x841acb7f42a3a78e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.326840:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463454.326842:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463454.326844:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463454.333903:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.334035:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466878976 00000100:00100000:2.0:1788463454.334049:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466878976 00000100:00100000:2.0:1788463454.334166:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 249 00000100:00100000:2.0:1788463454.334178:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+26:12484:x1875339466878976:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463454.334221:0:10067:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463454.334481:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+26:12484:x1875339466878976:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 304us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463454.334512:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 249 00000100:00100000:0.0:1788463454.342500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.342808:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466879232 00000100:00100000:1.0:1788463454.342823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466879232 00000100:00100000:1.0:1788463454.342913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 250 00000100:00100000:1.0:1788463454.342926:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+26:12484:x1875339466879232:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463454.342963:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463454.342990:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a795 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a7f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.343168:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a79c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.343187:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.343202:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463454.343217:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788463454.343749:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0dc00/0x841acb7f42a3a795 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a7f expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.343771:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a79c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a7f expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463454.343781:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:1.0:1788463454.343784:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463454.343789:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0cc00, rc 0) 00000100:00100000:1.0:1788463454.343890:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+28:12484:x1875339466879232:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 957us (1397us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788463454.343899:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 250 00000100:00100000:0.0:1788463454.351112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.351329:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466879488 00000100:00100000:2.0:1788463454.351354:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466879488 00000100:00100000:2.0:1788463454.351436:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 251 00000100:00100000:2.0:1788463454.351450:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+28:12484:x1875339466879488:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463454.351571:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351632:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351647:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351867:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351876:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351894:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351901:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463454.351907:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351916:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351956:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463454.351959:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463454.351966:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463454.351973:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3a7aa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463454.352355:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463454.352362:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788463454.352518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463454.352665:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466879616 00000100:00100000:3.0:1788463454.352673:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466879616 00000100:00100000:3.0:1788463454.352718:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 252 00000100:00100000:3.0:1788463454.352727:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+30:12486:x1875339466879616:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463454.352745:0:10067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463454.352764:0:10067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a86 expref: -99 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352830:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352842:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352853:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352869:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352876:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.352911:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463454.352916:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788463454.352929:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788463454.352998:0:10067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.353010:0:10067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 31 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.353021:0:10067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.353063:0:10067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 31 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.353079:0:10067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 31 pid: 12162 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463454.353095:0:10067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485810688:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463454.353203:0:10067:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fc270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463454.355120:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+31:12484:x1875339466879488:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 3647us (3998us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788463454.355141:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 251 00000100:00100000:0.0:1788463454.357616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463454.357686:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463454.357924:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466879872 00000100:00100000:2.0:1788463454.358006:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466879872 00000100:00100000:2.0:1788463454.358068:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880128 00000100:00100000:2.0:1788463454.358071:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880128 00000100:00100000:2.0:1788463454.358088:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:2.0:1788463454.358100:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+32:12484:x1875339466879872:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788463454.358543:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+33:12484:x1875339466879872:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 444us (971us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788463454.358552:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:2.0:1788463454.358597:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:2.0:1788463454.358607:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+32:6171:x1875339466880128:12345-192.168.204.53@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788463454.358685:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+33:6171:x1875339466880128:12345-192.168.204.53@tcp:35:ldlm_bl.0 Request processed in 78us (996us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788463454.358692:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:3.0:1788463454.358739:0:10067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10067:1875339485810688:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463454.358781:0:10067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463454.361022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463454.361135:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880256 00000100:00100000:0.0:1788463454.361149:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880256 00010000:00010000:0.0:1788463454.361212:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 33 pid: 12162 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463454.361263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 108 00000100:00100000:0.0:1788463454.361275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+33:2403:x1875339466880256:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463454.361298:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463454.361307:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 33 pid: 12162 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361323:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 33 pid: 12162 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361364:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3a6b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a40 expref: 33 pid: 12162 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361407:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:0.0:1788463454.361413:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361424:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361433:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463454.361469:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463454.361612:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68497686-852f-43ff-8be6-586d5980ece4+32:2403:x1875339466880256:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 338us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.361620:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 108 00010000:00010000:3.0:1788463454.361955:0:10067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.361966:0:10067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463454.362047:0:10067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788463454.362052:0:10067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463454.362080:0:10067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362096:0:10067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362120:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362133:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362141:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362147:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdea00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463454.362152:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362161:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362179:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:3.0:1788463454.362182:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463454.362186:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362192:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdea00/0x841acb7f42a3a7b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362218:0:10067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362224:0:10067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362230:0:10067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362235:0:10067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463454.362238:0:10067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362245:0:10067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362253:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff961885469800) 00010000:00010000:3.0:1788463454.362255:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463454.362258:0:10067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362264:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf000/0x841acb7f42a3a7bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362310:0:10067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a86 expref: 32 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362327:0:10067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a86 expref: 31 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463454.362357:0:10067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463454.362360:0:10067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463454.362363:0:10067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde800, rc 0) 00000100:00100000:3.0:1788463454.362410:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+31:12486:x1875339466879616:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 9684us (9894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463454.362418:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 252 00000100:00100000:3.0:1788463454.446568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.446909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880384 00000100:00100000:1.0:1788463454.446922:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880384 00000100:00100000:1.0:1788463454.450263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 404 00000100:00100000:1.0:1788463454.450295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466880384:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463454.450436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466880384:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 157us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463454.450447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 404 00000100:00100000:1.0:1788463454.462794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.462845:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.462877:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463454.462918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463454.463028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880512 00000100:00100000:0.0:1788463454.463045:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880512 00000100:00100000:0.0:1788463454.463161:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880768 00000100:00100000:0.0:1788463454.463165:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880768 00000100:00100000:0.0:1788463454.463203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880896 00000100:00100000:0.0:1788463454.463207:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880896 00000100:00100000:0.0:1788463454.463230:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 391 00000100:00100000:0.0:1788463454.463438:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466880512:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463454.463548:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466880512:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 308us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.463557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 391 00000100:00100000:0.0:1788463454.463611:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 392 00000100:00100000:0.0:1788463454.463619:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466880768:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463454.463664:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466880768:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 47us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.463672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 392 00000100:00100000:0.0:1788463454.463685:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 393 00000100:00100000:0.0:1788463454.463692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466880896:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463454.463716:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466880896:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.463722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 393 00000100:00100000:0.0:1788463454.463752:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466880640 00000100:00100000:0.0:1788463454.463756:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466880640 00000100:00100000:0.0:1788463454.463798:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:0.0:1788463454.463805:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466880640:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463454.463830:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466880640:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463454.463836:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00080000:0.0:1788463454.463890:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463454.463896:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463454.463898:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788463454.859789:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463455.107807:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463455.107837:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485810816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463455.107945:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463455.108030:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485810816 00000100:00100000:0.0:1788463455.108040:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485810816 00000100:00100000:0.0:1788463455.108112:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788463455.108124:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485810816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463455.110409:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788463455.110541:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485810816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2413us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463455.110553:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788463455.110625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463455.110786:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485810816:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788463455.375298:0:14672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463455.375311:0:14672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463455.384909:0:14672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788463455.384924:0:14672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463455.622815:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485810944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463455.622929:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463455.624617:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485810944 00000100:00100000:2.0:1788463455.624639:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485810944 00000100:00100000:2.0:1788463455.624716:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788463455.624869:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463455.624909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881152 00000100:00100000:1.0:1788463455.624915:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881152 00000100:00100000:1.0:1788463455.624965:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 253 00000100:00100000:1.0:1788463455.624978:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+31:12509:x1875339466881152:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463455.625012:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463455.625040:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a7cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a8d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.625189:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a7d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.625208:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.625225:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a7d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463455.625239:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788463455.625375:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0de00/0x841acb7f42a3a7cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a8d expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.625413:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a8d expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.625423:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:1.0:1788463455.625426:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788463455.625431:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463455.625501:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+33:12509:x1875339466881152:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 528us (644us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788463455.625509:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 253 00000100:00100000:2.0:1788463455.625896:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485810944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463455.625934:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788463455.626013:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485810944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1284us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463455.626020:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788463455.626085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485810944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463455.630640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463455.630726:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881280 00000100:00100000:3.0:1788463455.630741:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881280 00000100:00100000:3.0:1788463455.630816:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:3.0:1788463455.630828:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+33:12509:x1875339466881280:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:3.0:1788463455.630932:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.630955:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.630970:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631018:0:12162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631026:0:12162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631051:0:12162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631057:0:12162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463455.631063:0:12162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631073:0:12162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631087:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:3.0:1788463455.631091:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463455.631097:0:12162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.631106:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde400/0x841acb7f42a3a7e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463455.631194:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:68497686-852f-43ff-8be6-586d5980ece4+33:12509:x1875339466881280:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 367us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.631202:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 254 00000100:00100000:1.0:1788463455.760815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463455.760936:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881408 00000100:00100000:0.0:1788463455.760950:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881408 00000100:00100000:0.0:1788463455.761038:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:0.0:1788463455.761050:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2400:x1875339466881408:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:0.0:1788463455.761076:0:9857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463455.761103:0:9857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3a7e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a94 expref: -99 pid: 9857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463455.761138:0:9857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a99c95d, atime: 0x6a99c95c, ctime: 0x6a99c95d, blocks: 0x8 00010000:00010000:0.0:1788463455.761163:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=495s v=(0 0) 00010000:00010000:0.0:1788463455.761168:0:9857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463455.761179:0:9857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3a7e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a94 expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.761201:0:9857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3a7e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a94 expref: 8 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.761218:0:9857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1600, rc 0) 00000100:00100000:0.0:1788463455.761319:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466881408:12345-192.168.204.53@tcp:101:cat.0 Request processed in 270us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463455.761327:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 79 00000100:00100000:1.0:1788463455.765009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463455.765162:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881536 00000100:00100000:3.0:1788463455.765177:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881536 00002000:00100000:3.0:1788463455.765247:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff96188d1c2680 x1875339466881536/t0(0) o3->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:591/0 lens 488/0 e 0 to 0 dl 1788463466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463455.765260:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188d1c2680 with x1875339466881536 ext(0->4095) 00002000:00010000:3.0:1788463455.765266:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188d1c2680 00000100:00100000:3.0:1788463455.765306:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463455.765327:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466881536:12345-192.168.204.53@tcp:3:cat.0 00000100:00100000:3.0:1788463455.765566:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:68497686-852f-43ff-8be6-586d5980ece4+8:2401:x1875339466881536:12345-192.168.204.53@tcp:3:cat.0 Request processed in 250us (572us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788463455.765600:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00002000:00100000:3.0:1788463455.765609:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff96188d1c2680 x1875339466881536/t0(0) o3->68497686-852f-43ff-8be6-586d5980ece4@192.168.204.53@tcp:591/0 lens 488/4536 e 0 to 0 dl 1788463466 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463455.765618:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff96188d1c2680 with x1875339466881536 ext(0->4095) 00002000:00010000:3.0:1788463455.765621:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff96188d1c2680 00010000:00010000:1.0:1788463455.876134:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463456.643965:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485811200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463456.644144:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485811456:0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.648224:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485811072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.648290:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485811328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.653562:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463456.654331:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485811712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.654619:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463456.654658:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485812224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.654682:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463456.654826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463456.654872:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485811584:0@lo:400:kworker.0 00000100:00100000:3.0:1788463456.655230:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811200 00000100:00100000:3.0:1788463456.655243:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811200 00000100:00100000:3.0:1788463456.655312:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811712 00000100:00100000:3.0:1788463456.655316:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811712 00000100:00100000:0.0:1788463456.655471:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485812736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463456.655514:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463456.655558:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812224 00000100:00100000:0.0:1788463456.655562:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812224 00000100:00100000:0.0:1788463456.655618:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788463456.655630:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485811200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.655805:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463456.655829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485812096:0@lo:400:kworker.0 00000100:00100000:3.0:1788463456.656322:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788463456.656335:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485812224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.656496:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463456.656528:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485812608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.656551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.656684:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.656715:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485811840:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.656742:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.656756:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485812352:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.656780:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.656795:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485812864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463456.656830:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.656882:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811584 00000100:00100000:2.0:1788463456.656889:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811584 00000100:00100000:0.0:1788463456.656912:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485811200:12345-0@lo:400:kworker.0 Request processed in 1272us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463456.656923:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788463456.656928:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811328 00000100:00100000:2.0:1788463456.656932:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811328 00000100:00100000:0.0:1788463456.656958:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811840 00000100:00100000:0.0:1788463456.656963:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811840 00000100:00100000:0.0:1788463456.656982:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812352 00000100:00100000:0.0:1788463456.656984:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812352 00000100:00100000:2.0:1788463456.657005:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788463456.657016:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788463456.657017:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485811584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.657028:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485811712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.657075:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485811584:12345-0@lo:400:kworker.0 Request processed in 62us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463456.657103:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788463456.657121:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788463456.657130:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485811328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.657167:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485811328:12345-0@lo:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.657288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811072 00000100:00100000:1.0:1788463456.657294:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811072 00000100:00100000:1.0:1788463456.657329:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788463456.657336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485811072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.657396:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3649:x1875339485811072:12345-0@lo:400:kworker.0 Request processed in 61us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.657402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788463456.658349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788463456.658357:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788463456.658373:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485811840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.658433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485811072:0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.658883:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485811840:12345-0@lo:400:kworker.0 Request processed in 520us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.658905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788463456.658926:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788463456.658934:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485812352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.658973:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485812352:12345-0@lo:400:kworker.0 Request processed in 41us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.658979:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788463456.659013:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812736 00000100:00100000:1.0:1788463456.659019:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812736 00000100:00100000:1.0:1788463456.659060:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812864 00000100:00100000:1.0:1788463456.659063:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812864 00000100:00100000:1.0:1788463456.659079:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788463456.659085:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485812736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463456.659110:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463456.659154:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485812736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.659160:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788463456.659171:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788463456.659177:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485812864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463456.659219:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463456.659242:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485812864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.659248:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788463456.659270:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463456.659275:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463456.659279:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463456.659802:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812096 00000100:00100000:1.0:1788463456.659809:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812096 00000100:00100000:1.0:1788463456.659859:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812608 00000100:00100000:1.0:1788463456.659862:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812608 00000100:00100000:1.0:1788463456.659880:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463456.660467:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485812096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.660538:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485812096:12345-0@lo:400:kworker.0 Request processed in 81us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.660547:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463456.660567:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788463456.660594:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485812608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.660627:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875339485812608:12345-0@lo:400:kworker.0 Request processed in 54us (4075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.660633:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788463456.660657:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485811584:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.660685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485812096:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.660698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485812608:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.660779:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485811328:0@lo:400:kworker.0 00010000:00080000:2.0:1788463456.660800:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b26680 x1875339485811840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463456.660815:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485811840:0@lo:400:kworker.0 00010000:00080000:2.0:1788463456.660833:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b24700 x1875339485812352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788463456.660851:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463456.660856:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485812352:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.660885:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485812864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463456.661009:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.661060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485811968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.661094:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.661143:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811968 00000100:00100000:1.0:1788463456.661240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485811456 00000100:00100000:1.0:1788463456.661247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811456 00000100:00100000:1.0:1788463456.661284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788463456.661290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485811456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463456.661325:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485811456:12345-0@lo:400:kworker.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463456.661402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788463456.661444:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485811968 00000100:00100000:2.0:1788463456.661496:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788463456.661505:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178847bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485811968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.661531:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485811712:12345-0@lo:400:kworker.0 Request processed in 4503us (6909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463456.661547:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178847bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485811968:12345-0@lo:400:kworker.0 Request processed in 42us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463456.661558:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788463456.661559:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788463456.661725:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485811968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.661734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485812480:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.661761:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463456.661790:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812480 00000100:00100000:2.0:1788463456.661795:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812480 00000100:00100000:0.0:1788463456.661831:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485812736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463456.661847:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788463456.661856:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485812480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.661895:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485812480:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463456.661901:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788463456.661998:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485812480:0@lo:400:kworker.0 00000100:00100000:2.0:1788463456.662027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485811456:0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.662117:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485811200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463456.662134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485811712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463456.662438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485812224:12345-0@lo:400:kworker.0 Request processed in 6104us (7751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.662448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788463456.662523:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485812224:0@lo:400:kworker.0 00010000:00010000:0.0:1788463456.899881:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463457.156234:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463457.156258:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485812992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463457.156349:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463457.156448:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485812992 00000100:00100000:1.0:1788463457.156457:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485812992 00000100:00100000:1.0:1788463457.156515:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788463457.156524:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485812992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463457.156563:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788463457.156636:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485812992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.156644:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788463457.156747:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485812992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463457.667948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485813120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463457.668026:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463457.668379:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813120 00000100:00100000:1.0:1788463457.668389:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813120 00000100:00100000:1.0:1788463457.668445:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788463457.668455:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485813120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463457.668488:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463457.668548:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485813120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.668556:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788463457.668654:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485813120:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463457.923774:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463458.438331:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463458.438342:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463458.438370:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788463458.438380:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788463458.756402:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463458.947829:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463459.565086:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463459.565136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463459.565237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881920 00000100:00100000:2.0:1788463459.565247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881920 00000100:00100000:2.0:1788463459.565331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 400 00000100:00100000:2.0:1788463459.565347:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466881920:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463459.565440:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466881920:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463459.565449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 400 00000100:00100000:1.0:1788463459.565530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881664 00000100:00100000:1.0:1788463459.565536:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881664 00000100:00100000:1.0:1788463459.565605:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 406 00000100:00100000:1.0:1788463459.565613:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466881664:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.565641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466881664:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.565648:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 406 00000100:00080000:3.0:1788463459.566458:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463459.566866:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463459.566914:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463459.566947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463459.566974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463459.567001:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463459.567027:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882176 00000100:00100000:1.0:1788463459.567044:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882176 00000100:00100000:1.0:1788463459.567086:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882048 00000100:00100000:1.0:1788463459.567089:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882048 00000100:00100000:1.0:1788463459.567112:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 146 00000100:00100000:1.0:1788463459.567120:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466882176:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.567172:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2400:x1875339466882176:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.567180:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 146 00000100:00100000:1.0:1788463459.567195:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:1.0:1788463459.567202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466882048:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.567229:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+8:2400:x1875339466882048:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.567235:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:1.0:1788463459.567252:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882432 00000100:00100000:1.0:1788463459.567255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882432 00000100:00100000:1.0:1788463459.567279:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466881792 00000100:00100000:1.0:1788463459.567282:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466881792 00000100:00100000:1.0:1788463459.567300:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882304 00000100:00100000:1.0:1788463459.567303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882304 00000100:00100000:1.0:1788463459.567318:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 401 00000100:00100000:1.0:1788463459.567325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466882432:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.567356:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466882432:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.567368:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 401 00000100:00100000:1.0:1788463459.567382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 402 00000100:00100000:1.0:1788463459.567389:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+33:2400:x1875339466881792:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.567418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+33:2400:x1875339466881792:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.567424:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 402 00000100:00100000:1.0:1788463459.567436:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 403 00000100:00100000:1.0:1788463459.567442:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466882304:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463459.567464:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2400:x1875339466882304:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463459.567471:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 403 00000100:00080000:1.0:1788463459.567493:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463459.567496:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463459.567499:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463459.567501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788463459.720182:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1788463459.720198:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788463459.720613:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788463459.720644:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff961787c66600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788463459.720651:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961882ff1300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff961787c663c0 00000020:00080000:1.0:1788463459.720654:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff961882ff1500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff96188cff5000 00000020:00080000:0.0:1788463459.720706:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:0.0:1788463459.720788:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788463459.720970:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.720981:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.720988:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.721009:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463459.721014:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.721021:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.721040:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff961885469200) 00010000:00010000:3.0:1788463459.721043:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463459.721047:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463459.721055:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3a764 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788463459.721175:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788463459.721298:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1788463459.971855:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463460.231837:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485813248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463460.233278:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463460.233436:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813248 00000100:00100000:0.0:1788463460.233445:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813248 00000100:00100000:0.0:1788463460.233595:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788463460.235757:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485813248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463460.235815:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788463460.235909:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485813248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463460.235918:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788463460.236050:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463460.236509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485813248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463460.740793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485813376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463460.740879:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463460.741548:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813376 00000100:00100000:2.0:1788463460.741558:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813376 00000100:00100000:2.0:1788463460.741650:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788463460.741660:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485813376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463460.741686:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788463460.741752:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485813376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463460.741769:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788463460.741812:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788463460.741819:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788463460.741925:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485813376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463460.742486:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463460.997185:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463461.178134:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463461.178347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882560 00000100:00100000:3.0:1788463461.178358:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882560 00000100:00100000:3.0:1788463461.178438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00100000:3.0:1788463461.178451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+19:12170:x1875339466882560:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788463461.178623:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68497686-852f-43ff-8be6-586d5980ece4+19:12170:x1875339466882560:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 176us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463461.178631:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 255 00000100:00080000:1.0:1788463461.179494:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463461.186773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463461.190766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882688 00000100:00100000:2.0:1788463461.190783:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882688 00000100:00100000:2.0:1788463461.190954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 256 00000100:00100000:2.0:1788463461.190972:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:12170:x1875339466882688:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788463461.191127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:12170:x1875339466882688:12345-192.168.204.53@tcp:60:lhsmtool_posix.0 Request processed in 161us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.191134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 256 00000100:00080000:1.0:1788463461.194210:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463461.196797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463461.198868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466882944 00000100:00100000:3.0:1788463461.198899:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466882944 00000100:00100000:3.0:1788463461.199279:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463461.199290:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+19:12170:x1875339466882944:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788463461.199548:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+20:12170:x1875339466882944:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 259us (2981us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788463461.199556:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463461.616516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463461.618996:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883072 00000100:00100000:0.0:1788463461.619014:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883072 00000100:00080000:1.0:1788463461.619115:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463461.619125:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 257 00000100:00100000:0.0:1788463461.619138:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:12966:x1875339466883072:12345-192.168.204.53@tcp:101:lsof.0 00010000:00010000:0.0:1788463461.619159:0:12162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463461.619182:0:12162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a7f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476a9b expref: -99 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619249:0:12162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619262:0:12162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619276:0:12162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463461.619340:0:12162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463461.619345:0:12162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463461.619367:0:12162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619393:0:12162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1000/0x841acb7f42a3a7f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a9b expref: 7 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619411:0:12162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a9b expref: 6 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463461.619435:0:12162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:0.0:1788463461.619438:0:12162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463461.619443:0:12162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0400, rc 0) 00000100:00100000:0.0:1788463461.619518:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:12966:x1875339466883072:12345-192.168.204.53@tcp:101:lsof.0 Request processed in 383us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463461.619525:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 257 00000100:00100000:0.0:1788463461.764074:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463461.764099:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485813504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463461.764235:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463461.764316:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813504 00000100:00100000:3.0:1788463461.764328:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813504 00000100:00080000:1.0:1788463461.764370:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463461.764379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463461.764391:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485813632:0@lo:400:kworker.0 00000100:00100000:3.0:1788463461.764398:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788463461.764411:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485813504:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463461.764420:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463461.764434:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485813760:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463461.764442:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463461.764442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463461.764484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813632 00000100:00100000:1.0:1788463461.764488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813632 00000100:00100000:3.0:1788463461.764491:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485813504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463461.764498:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788463461.764504:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463461.764519:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813760 00000100:00100000:3.0:1788463461.764523:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813760 00000100:00100000:1.0:1788463461.764523:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1788463461.764531:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485813632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463461.764553:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788463461.764560:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485813760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463461.764571:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788463461.764601:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3648:x1875339485813632:12345-0@lo:400:kworker.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463461.764608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1788463461.764626:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485813632:0@lo:400:kworker.0 00000100:00100000:3.0:1788463461.764630:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485813760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00080000:1.0:1788463461.764635:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463461.764638:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788463461.764657:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485813888:0@lo:400:kworker.0 00000100:00100000:3.0:1788463461.764684:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463461.764709:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:1.0:1788463461.764709:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485814272:0@lo:400:kworker.0 00000004:00080000:3.0:1788463461.764719:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96188cf33480, transno 4294967311 00000100:00100000:3.0:1788463461.764735:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485813760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463461.764735:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463461.764773:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814272 00000100:00100000:1.0:1788463461.764777:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814272 00000100:00100000:1.0:1788463461.764799:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788463461.764820:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485814272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485814016:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765344:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.765377:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463461.765382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485814144:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.765442:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485813888 00000100:00100000:2.0:1788463461.765445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485813888 00000100:00100000:2.0:1788463461.765474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814144 00000100:00100000:2.0:1788463461.765478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814144 00000100:00100000:2.0:1788463461.765493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788463461.765500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485813888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765533:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485813888:12345-0@lo:400:kworker.0 Request processed in 34us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.765540:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788463461.765552:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788463461.765570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485814144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485814144:12345-0@lo:400:kworker.0 Request processed in 59us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.765621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788463461.765647:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485814144:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765700:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485814528:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.765770:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463461.765785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485814656:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.765849:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814656 00000100:00100000:2.0:1788463461.765853:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814656 00000100:00100000:2.0:1788463461.765898:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788463461.765905:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485814656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.765937:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485814656:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.765943:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788463461.765971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485814656:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485815040:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.766364:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814528 00000100:00100000:2.0:1788463461.766369:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814528 00000100:00100000:2.0:1788463461.766396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815040 00000100:00100000:2.0:1788463461.766399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815040 00000100:00100000:2.0:1788463461.766414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788463461.766420:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485814528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766455:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485814528:12345-0@lo:400:kworker.0 Request processed in 36us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.766460:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788463461.766472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1788463461.766478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485815040:12345-0@lo:400:kworker.0 Request processed in 23us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.766505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:2.0:1788463461.766528:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788463461.766547:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d5c00 x1875339485815040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463461.766558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485815040:0@lo:400:kworker.0 00010000:00080000:2.0:1788463461.766567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b26680 x1875339485814528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463461.766596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485814528:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766640:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485814784:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766666:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.766692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485814272:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766704:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463461.766710:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485814400:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766731:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.766758:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485814912:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.766779:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463461.766798:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814784 00000100:00100000:2.0:1788463461.766801:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814784 00000100:00100000:2.0:1788463461.766837:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788463461.766842:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463461.767293:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485814272:12345-0@lo:400:kworker.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463461.767305:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788463461.767329:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814016 00000100:00100000:1.0:1788463461.767332:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814016 00000100:00100000:1.0:1788463461.767352:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788463461.767358:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485814016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463461.767399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485814016:12345-0@lo:400:kworker.0 Request processed in 41us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463461.767404:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788463461.767917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814400 00000100:00100000:0.0:1788463461.767922:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814400 00000100:00100000:0.0:1788463461.767956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485814912 00000100:00100000:0.0:1788463461.767960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485814912 00000100:00100000:0.0:1788463461.767976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788463461.767981:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485814400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463461.768043:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485814400:12345-0@lo:400:kworker.0 Request processed in 61us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463461.768050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788463461.768063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788463461.768127:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485813888:0@lo:400:kworker.0 00000100:00080000:3.0:1788463461.768196:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463461.768222:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485814400:0@lo:400:kworker.0 00000100:00100000:0.0:1788463461.768287:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485814912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463461.768334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485814912:12345-0@lo:400:kworker.0 Request processed in 265us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463461.768341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788463461.768380:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485813504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463461.769020:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485814016:0@lo:400:kworker.0 00000100:00100000:3.0:1788463461.769096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485814912:0@lo:400:kworker.0 00000100:00100000:2.0:1788463461.769427:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485814784:12345-0@lo:400:kworker.0 Request processed in 2581us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463461.769669:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463461.769801:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485814784:0@lo:400:kworker.0 00010000:00010000:1.0:1788463462.020104:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463462.275972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485815168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463462.276081:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463462.276268:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815168 00000100:00100000:1.0:1788463462.276278:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815168 00000100:00100000:1.0:1788463462.276332:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788463462.276342:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485815168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463462.276380:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788463462.276439:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485815168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463462.276446:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788463462.276697:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485815168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463462.788734:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463462.788759:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485815296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463462.788834:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463462.789256:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815296 00000100:00100000:3.0:1788463462.789267:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815296 00000100:00100000:3.0:1788463462.789329:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788463462.789339:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485815296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463462.789374:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788463462.789439:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485815296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463462.789447:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788463462.789603:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485815296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463463.045156:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463464.067758:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463464.699052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699186:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699201:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699231:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463464.699264:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883712 00000100:00100000:0.0:1788463464.699273:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883712 00000100:00100000:0.0:1788463464.699327:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883584 00000100:00100000:0.0:1788463464.699330:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883584 00000100:00100000:0.0:1788463464.699350:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:0.0:1788463464.699360:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466883712:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463464.699426:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466883712:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463464.699434:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:0.0:1788463464.699450:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:0.0:1788463464.699456:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466883584:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463464.699479:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:68497686-852f-43ff-8be6-586d5980ece4+7:2402:x1875339466883584:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463464.699486:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:3.0:1788463464.699613:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883456 00000100:00100000:3.0:1788463464.699619:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883456 00000100:00100000:3.0:1788463464.699644:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883968 00000100:00100000:3.0:1788463464.699647:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883968 00000100:00100000:3.0:1788463464.699662:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883328 00000100:00100000:3.0:1788463464.699665:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883328 00000100:00100000:3.0:1788463464.699677:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883840 00000100:00100000:3.0:1788463464.699689:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883840 00000100:00100000:3.0:1788463464.699714:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 410 00000100:00100000:3.0:1788463464.699720:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466883456:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463464.699760:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2402:x1875339466883456:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463464.699780:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 410 00000100:00100000:3.0:1788463464.699793:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 411 00000100:00100000:3.0:1788463464.699799:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466883968:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463464.699824:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2402:x1875339466883968:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463464.699831:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 411 00000100:00100000:3.0:1788463464.699842:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 412 00000100:00100000:3.0:1788463464.699848:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+20:2402:x1875339466883328:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463464.699878:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+20:2402:x1875339466883328:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463464.699885:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 412 00000100:00100000:3.0:1788463464.699896:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 413 00000100:00100000:3.0:1788463464.699902:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466883840:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463464.699922:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2402:x1875339466883840:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463464.699928:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 413 00000100:00080000:3.0:1788463464.699945:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463464.699948:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463464.699951:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463464.699953:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463464.700356:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466883200 00000100:00100000:2.0:1788463464.700362:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466883200 00000100:00100000:2.0:1788463464.700404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 408 00000100:00100000:2.0:1788463464.700413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466883200:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463464.700456:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2402:x1875339466883200:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 44us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463464.700462:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 408 00010000:00010000:1.0:1788463465.093858:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788463465.353532:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1788463465.353546:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788463465.353662:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788463465.353693:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788463465.353970:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485815424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463465.354205:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463465.354441:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815424 00000100:00100000:3.0:1788463465.354450:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815424 00000100:00100000:3.0:1788463465.354517:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788463465.354528:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485815424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463465.354593:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788463465.354639:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485815424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463465.354647:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1788463465.354721:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463465.354769:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485815424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463465.866009:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463465.866033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485815552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463465.866106:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463465.866296:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815552 00000100:00100000:0.0:1788463465.866304:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815552 00000100:00100000:0.0:1788463465.866374:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788463465.866391:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485815552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463465.866427:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788463465.866475:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485815552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463465.866482:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788463465.866530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485815552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463465.866593:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463466.130246:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463466.418958:0:14870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:24:25 (1788463465) 00000100:00100000:0.0:1788463466.884501:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463466.884527:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485815680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463466.884635:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463466.884844:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463466.884854:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485815808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463466.884883:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463466.884917:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815680 00000100:00100000:2.0:1788463466.884925:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815680 00000100:00100000:2.0:1788463466.885145:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815808 00000100:00100000:2.0:1788463466.885163:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815808 00000100:00100000:3.0:1788463466.885173:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788463466.885203:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485815680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463466.885264:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463466.885363:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485815680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463466.885372:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788463466.885400:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788463466.885408:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485815808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463466.885419:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463466.885474:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485815808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463466.885485:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788463466.885566:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485815680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463466.885697:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485815808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463466.886118:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485816320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463466.886198:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.886346:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485816192:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886383:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.886410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485816704:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886464:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485815936:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886514:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.886546:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485816448:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886570:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.886614:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485816960:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886658:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463466.886662:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816192 00000100:00100000:0.0:1788463466.886675:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816192 00000100:00100000:3.0:1788463466.886727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485815936 00000100:00100000:0.0:1788463466.886734:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816448 00000100:00100000:3.0:1788463466.886740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485815936 00000100:00100000:0.0:1788463466.886741:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816448 00000100:00100000:0.0:1788463466.886768:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788463466.886783:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485816192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788463466.886823:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485815936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.886886:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485816192:12345-0@lo:400:kworker.0 Request processed in 108us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.886894:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788463466.886920:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788463466.886929:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485816448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.886959:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485815936:12345-0@lo:400:kworker.0 Request processed in 136us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463466.886969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788463466.886999:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485816448:12345-0@lo:400:kworker.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.887011:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788463466.887253:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485816832:0@lo:400:kworker.0 00000100:00100000:1.0:1788463466.887290:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788463466.887338:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463466.887394:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816960 00000100:00100000:3.0:1788463466.887399:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816960 00000100:00100000:3.0:1788463466.887488:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816832 00000100:00100000:3.0:1788463466.887492:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816832 00000100:00100000:2.0:1788463466.887598:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816320 00000100:00100000:2.0:1788463466.887606:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816320 00000100:00100000:2.0:1788463466.887688:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1788463466.887704:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485816320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463466.887791:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485816320:12345-0@lo:400:kworker.0 Request processed in 91us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463466.887803:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1788463466.888759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463466.888786:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485816960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.888848:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788463466.888855:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485816960:12345-0@lo:400:kworker.0 Request processed in 76us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463466.888863:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463466.888875:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485816832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463466.888935:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485816320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463466.888985:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485816832:0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.889128:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485816832:12345-0@lo:400:kworker.0 Request processed in 264us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.889163:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788463466.891352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.891435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485817216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.891514:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463466.891876:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463466.891941:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485816192:0@lo:400:kworker.0 00000100:00100000:2.0:1788463466.892436:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485816576:0@lo:400:kworker.0 00000100:00100000:2.0:1788463466.892486:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463466.892607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816704 00000100:00100000:1.0:1788463466.892618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816704 00000100:00100000:3.0:1788463466.892768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817216 00000100:00100000:3.0:1788463466.892773:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817216 00000100:00100000:1.0:1788463466.892830:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816064 00000100:00100000:1.0:1788463466.892834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816064 00000100:00100000:0.0:1788463466.892971:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788463466.892985:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485816704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.893077:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485816704:12345-0@lo:400:kworker.0 Request processed in 95us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.893085:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788463466.893107:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788463466.893113:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485817216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.893143:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875339485817216:12345-0@lo:400:kworker.0 Request processed in 31us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.893149:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788463466.893163:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1788463466.893169:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485816064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463466.893199:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485816064:12345-0@lo:400:kworker.0 Request processed in 30us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463466.893205:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00080000:3.0:1788463466.893276:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2dc00 x1875339485816704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463466.893292:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485816704:0@lo:400:kworker.0 00010000:00080000:3.0:1788463466.893304:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787c2e680 x1875339485817216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463466.893335:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485817216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.893405:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485815936:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.893422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485816448:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.893435:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485816960:0@lo:400:kworker.0 00000100:00080000:1.0:1788463466.894000:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463466.894329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485817088:0@lo:400:kworker.0 00000100:00100000:2.0:1788463466.894395:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463466.896055:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788463466.896310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485816576 00000100:00100000:3.0:1788463466.896321:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485816576 00000100:00100000:3.0:1788463466.896458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817088 00000100:00100000:3.0:1788463466.896463:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817088 00000100:00100000:1.0:1788463466.896522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788463466.896536:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485816576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463466.896660:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485816576:12345-0@lo:400:kworker.0 Request processed in 128us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463466.896668:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788463466.896835:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485816576:0@lo:400:kworker.0 00000100:00080000:0.0:1788463466.896948:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463466.897403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1788463466.897417:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485817088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463466.897523:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485817088:12345-0@lo:400:kworker.0 Request processed in 109us (3125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463466.897535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788463466.897671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485817088:0@lo:400:kworker.0 00010000:00010000:2.0:1788463467.141728:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463467.402115:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485817344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463467.402184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463467.402775:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817344 00000100:00100000:1.0:1788463467.402784:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817344 00000100:00100000:1.0:1788463467.418801:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788463467.418818:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485817344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463467.418858:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788463467.418959:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485817344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (16775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463467.418967:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788463467.419034:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485817344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463467.919980:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485817472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463467.920106:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463467.920187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817472 00000100:00100000:1.0:1788463467.920196:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817472 00000100:00100000:1.0:1788463467.920242:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788463467.920252:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485817472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463467.920288:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463467.920334:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485817472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463467.920342:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788463467.920390:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485817472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463468.163826:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463468.683959:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463468.683969:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463468.684083:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788463468.684092:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788463468.996763:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463469.191073:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463469.805241:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805337:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805375:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805500:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463469.805527:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884608 00000100:00100000:0.0:1788463469.805539:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884608 00000100:00100000:0.0:1788463469.805644:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884480 00000100:00100000:0.0:1788463469.805647:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884480 00000100:00100000:0.0:1788463469.805672:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:0.0:1788463469.805682:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466884608:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463469.805754:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466884608:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463469.805762:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 154 00000100:00100000:0.0:1788463469.805782:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00100000:0.0:1788463469.805788:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466884480:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463469.805813:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+7:2401:x1875339466884480:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463469.805819:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 155 00000100:00080000:0.0:1788463469.805835:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463469.805839:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463469.806625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884096 00000100:00100000:1.0:1788463469.806633:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884096 00000100:00100000:1.0:1788463469.806702:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 410 00000100:00100000:1.0:1788463469.806711:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466884096:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463469.806762:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2401:x1875339466884096:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 52us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463469.806770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 410 00000100:00100000:1.0:1788463469.806804:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884352 00000100:00100000:1.0:1788463469.806807:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884352 00000100:00100000:1.0:1788463469.806839:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884864 00000100:00100000:1.0:1788463469.806841:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884864 00000100:00100000:1.0:1788463469.806855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884224 00000100:00100000:1.0:1788463469.806857:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884224 00000100:00100000:1.0:1788463469.806869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466884736 00000100:00100000:1.0:1788463469.806881:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466884736 00000100:00100000:1.0:1788463469.806899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 420 00000100:00100000:1.0:1788463469.806905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466884352:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463469.806947:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2401:x1875339466884352:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 42us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463469.806954:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 420 00000100:00100000:1.0:1788463469.806968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 421 00000100:00100000:1.0:1788463469.806975:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466884864:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463469.807000:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2401:x1875339466884864:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463469.807006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 421 00000100:00100000:1.0:1788463469.807018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 422 00000100:00100000:1.0:1788463469.807025:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+19:2401:x1875339466884224:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463469.807050:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68497686-852f-43ff-8be6-586d5980ece4+19:2401:x1875339466884224:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463469.807067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 422 00000100:00100000:1.0:1788463469.807095:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 423 00000100:00100000:1.0:1788463469.807102:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2401:x1875339466884736:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463469.807128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2401:x1875339466884736:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 27us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463469.807134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 423 00000100:00080000:0.0:1788463469.808381:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463469.808390:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788463470.211807:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463470.477314:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463470.484716:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485817600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463470.484830:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463470.485010:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817600 00000100:00100000:1.0:1788463470.485019:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817600 00000100:00080000:2.0:1788463470.486492:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463470.487415:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788463470.487438:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485817600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463470.487474:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788463470.487566:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485817600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463470.487598:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788463470.487703:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485817600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463470.980537:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463470.980909:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485817728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463470.980980:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463470.981074:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817728 00000100:00100000:0.0:1788463470.981087:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817728 00000100:00100000:0.0:1788463470.981169:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788463470.981179:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485817728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463470.981203:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788463470.981269:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485817728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463470.981277:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788463470.981327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485817728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463470.981547:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463471.243372:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463471.913232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463471.913485:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466885120 00000100:00100000:0.0:1788463471.913502:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466885120 00000100:00100000:0.0:1788463471.913656:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:0.0:1788463471.913679:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+19:13190:x1875339466885120:12345-192.168.204.53@tcp:35:umount.0 00000100:00100000:0.0:1788463471.914192:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+20:13190:x1875339466885120:12345-192.168.204.53@tcp:35:umount.0 Request processed in 523us (976us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788463471.914200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00080000:3.0:1788463471.915261:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463471.925424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463471.925619:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466885376 00000100:00100000:1.0:1788463471.925634:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466885376 00000100:00100000:1.0:1788463471.925709:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463471.925722:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+20:13190:x1875339466885376:12345-192.168.204.53@tcp:35:umount.0 00000100:00100000:1.0:1788463471.926154:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+21:13190:x1875339466885376:12345-192.168.204.53@tcp:35:umount.0 Request processed in 433us (745us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788463471.926163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:1.0:1788463471.936454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463471.936648:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466885632 00000100:00100000:2.0:1788463471.936659:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466885632 00000100:00100000:2.0:1788463471.936742:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:2.0:1788463471.936752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961886cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+21:13190:x1875339466885632:12345-192.168.204.53@tcp:35:umount.0 00000100:00100000:2.0:1788463471.936974:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961886cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68497686-852f-43ff-8be6-586d5980ece4+22:13190:x1875339466885632:12345-192.168.204.53@tcp:35:umount.0 Request processed in 223us (529us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788463471.936999:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:3.0:1788463471.950191:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463471.950345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466885888 00000100:00100000:0.0:1788463471.950355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466885888 00000100:00100000:0.0:1788463471.950419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:0.0:1788463471.950430:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+22:13190:x1875339466885888:12345-192.168.204.53@tcp:35:umount.0 00000100:00100000:1.0:1788463471.951273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68497686-852f-43ff-8be6-586d5980ece4+23:13190:x1875339466885888:12345-192.168.204.53@tcp:35:umount.0 Request processed in 841us (1088us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788463471.951303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:3.0:1788463471.959999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463471.960062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463471.961791:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463471.965403:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466886016 00000100:00100000:2.0:1788463471.965419:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466886016 00000100:00100000:2.0:1788463471.965497:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466886272 00000100:00100000:2.0:1788463471.965500:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466886272 00000100:00100000:1.0:1788463471.965684:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:1.0:1788463471.965699:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+14:2400:x1875339466886016:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463471.965716:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463471.965740:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00f400/0x841acb7f42a397ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765ee expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463471.965761:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463471.965844:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:afa1ff74-abed-45cf-941d-a3a930cb8d12+13:2400:x1875339466886016:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 139us (5842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463471.965852:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463471.966061:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463471.966070:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+12:2400:x1875339466886272:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463471.966079:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463471.966089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813e00/0x841acb7f42a39a21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c7 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463471.966101:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463471.966123:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:2400:x1875339466886272:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 55us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463471.966129:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:3.0:1788463471.968536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463471.968610:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466886400 00000100:00100000:3.0:1788463471.968619:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466886400 00000100:00100000:3.0:1788463471.968669:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 80 00000100:00100000:3.0:1788463471.968678:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466886400:12345-192.168.204.53@tcp:9:umount.0 00000020:00000080:3.0:1788463471.968720:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39aec 00000100:00080000:3.0:1788463471.968728:0:8440:0:(import.c:65:import_set_state_nolock()) ffff961787f94800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463471.968768:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788463471.968977:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466886144 00000100:00100000:1.0:1788463471.968983:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466886144 00000100:00100000:1.0:1788463471.969017:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:1.0:1788463471.969024:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:2400:x1875339466886144:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463471.969034:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463471.969050:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0da00/0x841acb7f42a39711 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765af expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463471.969066:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463471.969106:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2400:x1875339466886144:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 83us (7323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463471.969113:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00080000:1.0:1788463471.969407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788463471.969495:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463471.972363:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68497686-852f-43ff-8be6-586d5980ece4+2:2399:x1875339466886400:12345-192.168.204.53@tcp:9:umount.0 Request processed in 3672us (3820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463471.972377:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 80 00000100:00100000:3.0:1788463471.986654:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463471.986749:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466886784 00000100:00100000:2.0:1788463471.986758:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466886784 00000100:00100000:2.0:1788463471.986826:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00100000:2.0:1788463471.986845:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+7:2399:x1875339466886784:12345-192.168.204.53@tcp:9:umount.0 00000020:00000080:2.0:1788463471.986881:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39d62 00000020:00010000:2.0:1788463471.986889:0:8439:0:(genops.c:1921:obd_stale_export_put()) Put export ffff961781da9000: total 0 00000100:00080000:2.0:1788463471.986893:0:8439:0:(import.c:65:import_set_state_nolock()) ffff96188f414800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463471.986934:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788463471.987093:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466886784:12345-192.168.204.53@tcp:9:umount.0 Request processed in 258us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463471.987101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 81 00000100:00080000:1.0:1788463471.987374:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1788463471.987661:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff961781da9000: total 0 00010000:00010000:0.0:1788463471.987712:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961781da9000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788463471.987768:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3a7e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a94 expref: 4 pid: 9857 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463471.987803:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bccc8d6/0x841acb7f42a3a11a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768b1 expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463471.987819:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961781da9000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788463471.987844:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463471.987847:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463471.987856:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463472.004025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485817984:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.004098:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463472.004161:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485818496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.004182:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463472.004205:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485819008:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.004224:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463472.004330:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485817856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463472.004382:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463472.004406:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485818368:0@lo:400:kworker.0 00000100:00100000:1.0:1788463472.004429:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463472.004446:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485818880:0@lo:400:kworker.0 00000100:00100000:1.0:1788463472.004468:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463472.004483:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485819392:0@lo:400:kworker.0 00000100:00100000:1.0:1788463472.004500:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463472.004564:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818368 00000100:00100000:1.0:1788463472.004589:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818368 00000100:00100000:1.0:1788463472.004677:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788463472.004686:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485818368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463472.004735:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485818368:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463472.004742:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788463472.004783:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485818368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.007603:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817856 00000100:00100000:3.0:1788463472.007618:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817856 00000100:00100000:3.0:1788463472.007677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788463472.007687:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485817856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.007760:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3650:x1875339485817856:12345-0@lo:400:kworker.0 Request processed in 76us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463472.007769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788463472.007802:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485817984 00000100:00100000:3.0:1788463472.007806:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485817984 00000100:00100000:3.0:1788463472.007839:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818496 00000100:00100000:3.0:1788463472.007842:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818496 00000100:00100000:3.0:1788463472.007932:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1788463472.007940:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485817984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.007987:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485817984:12345-0@lo:400:kworker.0 Request processed in 49us (3890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463472.007994:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1788463472.008004:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819008 00000100:00100000:3.0:1788463472.008007:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819008 00000100:00100000:3.0:1788463472.008154:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788463472.008161:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485818496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.008191:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485818496:12345-0@lo:400:kworker.0 Request processed in 31us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463472.008197:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788463472.008208:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1788463472.008213:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.008396:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818880 00000100:00100000:2.0:1788463472.008401:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818880 00000100:00100000:2.0:1788463472.008427:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819392 00000100:00100000:2.0:1788463472.008429:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819392 00000100:00100000:2.0:1788463472.008447:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788463472.008457:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.008493:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485818880:12345-0@lo:400:kworker.0 Request processed in 40us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463472.008499:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788463472.008511:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788463472.008517:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485819392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.008557:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485819392:12345-0@lo:400:kworker.0 Request processed in 40us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463472.008563:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788463472.008644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463472.008663:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466887808 00000100:00100000:2.0:1788463472.008666:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466887808 00000100:00100000:2.0:1788463472.008689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 258 00000100:00100000:2.0:1788463472.008696:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+23:2399:x1875339466887808:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:2.0:1788463472.008714:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39726 00000020:00010000:2.0:1788463472.008729:0:6523:0:(genops.c:1921:obd_stale_export_put()) Put export ffff961787a5b000: total 0 00000100:00080000:2.0:1788463472.008733:0:6523:0:(import.c:65:import_set_state_nolock()) ffff961787a5d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463472.008757:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788463472.008908:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68497686-852f-43ff-8be6-586d5980ece4+22:2399:x1875339466887808:12345-192.168.204.53@tcp:39:umount.0 Request processed in 212us (264us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788463472.008916:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 258 00000020:00010000:2.0:1788463472.008935:0:8455:0:(genops.c:1907:obd_stale_export_get()) Get export ffff961787a5b000: total 0 00010000:00010000:2.0:1788463472.009002:0:8455:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961787a5b000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788463472.009092:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463472.009096:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463472.009104:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812c00/0x841acb7f42a3a19f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768d4 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009155:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463472.009158:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788463472.009163:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3a79c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a7f expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009178:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463472.009180:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463472.009185:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf400/0x841acb7f42a39ffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476864 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009209:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961894655700) 00010000:00010000:2.0:1788463472.009212:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463472.009216:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a39a4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766d5 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009384:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:2.0:1788463472.009387:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463472.009392:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0c00/0x841acb7f42a3a183 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768cd expref: 17 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009406:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463472.009409:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463472.009421:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d800/0x841acb7f42a3a7d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a8d expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009438:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463472.009441:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463472.009445:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a39ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766f1 expref: 15 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009458:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463472.009460:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463472.009464:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0600/0x841acb7f42a3a0db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc47689c expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009477:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff961787b9ac00) 00010000:00010000:2.0:1788463472.009480:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463472.009484:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1400/0x841acb7f42a3a48c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4769ad expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009501:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff961885469600) 00010000:00010000:2.0:1788463472.009504:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463472.009507:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfa00/0x841acb7f42a39dbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4767ca expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009522:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961787b98100) 00010000:00010000:2.0:1788463472.009525:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463472.009528:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a39a67 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766dc expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009555:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463472.009563:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463472.009569:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27000/0x841acb7f42a3a6ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a47 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009620:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff961894655500) 00010000:00010000:2.0:1788463472.009623:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463472.009627:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde800/0x841acb7f42a3a7c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a86 expref: 9 pid: 10067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009644:0:8455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff961894655000) 00010000:00010000:2.0:1788463472.009647:0:8455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463472.009650:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc1e00/0x841acb7f42a3a105 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4768aa expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463472.009664:0:8455:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961787a5b000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788463472.009688:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463472.009690:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463472.009692:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463472.009787:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485817856:0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.009804:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485818880:0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.009814:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485819392:0@lo:400:kworker.0 00000100:00100000:2.0:1788463472.009839:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463472.009848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485819520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463472.010036:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485818112:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010102:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485818624:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010154:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485819136:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010212:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463472.010248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010270:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788463472.010277:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485818240:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010300:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010311:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485818752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010352:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819264:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.010405:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818112 00000100:00100000:0.0:1788463472.010410:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818112 00000100:00100000:0.0:1788463472.010448:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788463472.010455:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485818112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010501:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485818112:12345-0@lo:400:kworker.0 Request processed in 46us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010508:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788463472.010525:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818624 00000100:00100000:0.0:1788463472.010528:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818624 00000100:00100000:0.0:1788463472.010564:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819136 00000100:00100000:0.0:1788463472.010604:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819136 00000100:00100000:0.0:1788463472.010628:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818240 00000100:00100000:0.0:1788463472.010631:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818240 00000100:00100000:0.0:1788463472.010644:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1788463472.010651:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010682:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485818624:12345-0@lo:400:kworker.0 Request processed in 32us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010688:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1788463472.010700:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1788463472.010706:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485819136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010732:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485819136:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010737:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1788463472.010748:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1788463472.010753:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485818240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010776:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485818240:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010782:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1788463472.010799:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485818752 00000100:00100000:0.0:1788463472.010804:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485818752 00000100:00100000:0.0:1788463472.010829:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819264 00000100:00100000:0.0:1788463472.010832:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819264 00000100:00100000:0.0:1788463472.010848:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463472.010855:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485818752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010899:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485818752:12345-0@lo:400:kworker.0 Request processed in 45us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010905:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463472.010923:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463472.010929:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.010960:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819264:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.010967:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463472.011004:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485818240:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.011015:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485818752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.011024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819264:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.011034:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485818112:0@lo:400:kworker.0 00010000:00080000:0.0:1788463472.011047:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc21c00 x1875339485818624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463472.011056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485818624:0@lo:400:kworker.0 00010000:00080000:0.0:1788463472.011065:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fc23480 x1875339485819136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463472.011071:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485819136:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.011106:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819648 00000100:00100000:0.0:1788463472.011109:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819648 00000100:00100000:0.0:1788463472.011134:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788463472.011140:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463472.011162:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463472.011203:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463472.011209:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788463472.011254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819648:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788463472.011395:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463472.011398:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463472.011400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463472.011402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463472.011422:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485817984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463472.011433:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485818496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.011842:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485819008:12345-0@lo:400:kworker.0 Request processed in 3626us (7614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463472.011851:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788463472.014226:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463472.014377:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485819008:0@lo:400:kworker.0 00000100:00100000:3.0:1788463472.014719:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819520 00000100:00100000:3.0:1788463472.014727:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819520 00000100:00100000:3.0:1788463472.014774:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788463472.014783:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485819520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463472.014807:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463472.014849:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485819520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463472.014867:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463472.015093:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485819520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463472.030877:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463472.031014:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466887936 00000100:00100000:0.0:1788463472.031027:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466887936 00000100:00100000:0.0:1788463472.031124:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 259 00000100:00100000:0.0:1788463472.031134:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+5:2399:x1875339466887936:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:0.0:1788463472.031168:0:10067:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3971f 00000100:00080000:1.0:1788463472.031184:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463472.031189:0:10067:0:(import.c:65:import_set_state_nolock()) ffff961786881000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463472.031228:0:10067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788463472.031405:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68497686-852f-43ff-8be6-586d5980ece4+3:2399:x1875339466887936:12345-192.168.204.53@tcp:39:umount.0 Request processed in 272us (539us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788463472.031414:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 259 00010000:00010000:3.0:1788463472.031965:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463472.259881:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463472.516087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463472.516112:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463472.516185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463472.516306:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819776 00000100:00100000:2.0:1788463472.516315:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819776 00000100:00100000:2.0:1788463472.516369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788463472.516379:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463472.516411:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788463472.516467:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485819776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463472.516474:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788463472.516702:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485819776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463473.028614:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463473.028643:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485819904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463473.028723:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463473.028876:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485819904 00000100:00100000:1.0:1788463473.028885:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485819904 00000100:00100000:1.0:1788463473.028952:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788463473.028962:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485819904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463473.028998:0:7732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788463473.029063:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485819904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463473.029085:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788463473.029543:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485819904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788463473.283765:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463474.308448:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463474.544330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463474.544388:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463474.544635:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888064 00000100:00100000:2.0:1788463474.544650:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888064 00000100:00100000:2.0:1788463474.544733:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888320 00000100:00100000:2.0:1788463474.544736:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888320 00000100:00100000:2.0:1788463474.544762:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:2.0:1788463474.544773:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+11:2401:x1875339466888064:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463474.544807:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463474.544833:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880031e00/0x841acb7f42a39822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476603 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463474.544857:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463474.544925:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+10:2401:x1875339466888064:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 154us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463474.544933:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:2.0:1788463474.544954:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463474.544961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+9:2401:x1875339466888320:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463474.544968:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463474.544978:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d400/0x841acb7f42a39a1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4766c0 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463474.544998:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463474.545018:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:2401:x1875339466888320:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 58us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463474.545025:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:0.0:1788463474.545803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463474.545870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463474.546246:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888576 00000100:00100000:3.0:1788463474.546259:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888576 00000100:00100000:3.0:1788463474.546333:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 260 00000100:00100000:3.0:1788463474.546344:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+6:2399:x1875339466888576:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:3.0:1788463474.546395:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39837 00000020:00010000:3.0:1788463474.546405:0:6522:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9618c1ad7800: total 0 00000100:00080000:3.0:1788463474.546411:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9618c1ad0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463474.546444:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788463474.546957:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2399:x1875339466888576:12345-192.168.204.53@tcp:39:umount.0 Request processed in 612us (1082us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788463474.546970:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 260 00000020:00010000:3.0:1788463474.547035:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9618c1ad7800: total 0 00010000:00010000:3.0:1788463474.547040:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463474.547101:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9618c1ad7800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788463474.547141:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961787b9af00) 00010000:00010000:3.0:1788463474.547146:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463474.547156:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787bc0400/0x841acb7f42a3a7f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476a9b expref: 4 pid: 12162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463474.547184:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9618c1ad7800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788463474.547194:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463474.547195:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463474.547197:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463474.547294:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888192 00000100:00100000:1.0:1788463474.547302:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888192 00000100:00100000:1.0:1788463474.547361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:1.0:1788463474.547371:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afa1ff74-abed-45cf-941d-a3a930cb8d12+8:2401:x1875339466888192:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463474.547386:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463474.547400:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4000/0x841acb7f42a39829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476634 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463474.547415:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463474.547441:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:afa1ff74-abed-45cf-941d-a3a930cb8d12+7:2401:x1875339466888192:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 72us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463474.547447:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00080000:0.0:1788463474.549527:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788463474.558872:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00080000:1.0:1788463474.558887:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788463474.558892:0:6502:0:(genops.c:885:class_export_put()) final put ffff9618c1ad7800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00100000:1.0:1788463474.558962:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000001:00080000:1.0:1788463474.558971:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788463474.558981:0:6502:0:(genops.c:885:class_export_put()) final put ffff961787a5b000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:2.0:1788463474.564689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ad7800/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d for lustre-MDT0000 00000020:00000080:2.0:1788463474.564759:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618c1ad0800 for lustre-MDT0000 00000100:00100000:2.0:1788463474.566255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463474.566386:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888704 00000100:00100000:3.0:1788463474.566398:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888704 00000100:00100000:3.0:1788463474.566473:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 261 00000100:00100000:3.0:1788463474.566484:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+5:2399:x1875339466888704:12345-192.168.204.53@tcp:39:umount.0 00000020:00000080:3.0:1788463474.566537:0:12162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3983e 00000100:00080000:3.0:1788463474.566559:0:12162:0:(import.c:65:import_set_state_nolock()) ffff961787257000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463474.566609:0:12162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788463474.566797:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788463474.567373:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463474.567420:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178714bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d+3:2399:x1875339466888704:12345-192.168.204.53@tcp:39:umount.0 Request processed in 936us (1172us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788463474.567430:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 261 00000020:00000080:3.0:1788463474.567830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787a5b000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-MDT0000 00000020:00000080:3.0:1788463474.567890:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787a5d000 for lustre-MDT0000 00000100:00100000:3.0:1788463474.726811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463474.726915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466888960 00000100:00100000:0.0:1788463474.726926:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466888960 00000100:00100000:0.0:1788463474.726993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 412 00000100:00100000:0.0:1788463474.727004:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+7:2399:x1875339466888960:12345-192.168.204.53@tcp:251:umount.0 00000020:00000080:0.0:1788463474.727051:0:6517:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a396fc 00000020:00010000:0.0:1788463474.727059:0:6517:0:(genops.c:1921:obd_stale_export_put()) Put export ffff961787c7e000: total 0 00000100:00080000:0.0:1788463474.727063:0:6517:0:(import.c:65:import_set_state_nolock()) ffff961787c7f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788463474.727154:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:afa1ff74-abed-45cf-941d-a3a930cb8d12+3:2399:x1875339466888960:12345-192.168.204.53@tcp:251:umount.0 Request processed in 153us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463474.727162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 412 00000020:00010000:2.0:1788463474.727558:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff961787c7e000: total 0 00010000:00010000:2.0:1788463474.727647:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff961787c7e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788463474.727685:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00fe00/0x841acb7f42a397d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc4765f5 expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463474.727702:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff961787c7e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788463474.727714:0:6511:0:(genops.c:885:class_export_put()) final put ffff961787c7e000/afa1ff74-abed-45cf-941d-a3a930cb8d12 00010000:00010000:2.0:1788463474.727732:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463474.727735:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463474.727737:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788463474.727777:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787c7e000/afa1ff74-abed-45cf-941d-a3a930cb8d12 for MGS 00000020:00000080:1.0:1788463474.727815:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787c7f000 for MGS 00010000:00010000:3.0:1788463475.341762:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463475.589106:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463475.589131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485820032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463475.589218:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463475.590175:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820032 00000100:00100000:0.0:1788463475.590186:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820032 00000100:00100000:0.0:1788463475.590263:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1788463475.590272:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463475.590274:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485820032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463475.590307:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788463475.590376:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787148380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485820032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463475.590382:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788463475.590519:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485820032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463476.100857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485820160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463476.100933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463476.101043:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820160 00000100:00100000:1.0:1788463476.101053:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820160 00000100:00100000:1.0:1788463476.101122:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788463476.101133:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485820160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463476.101156:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788463476.101258:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485820160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463476.101266:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1788463476.102126:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463476.102537:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485820160:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463476.355893:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463477.124216:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463477.124239:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485820288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463477.124313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463477.124491:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820288 00000100:00100000:0.0:1788463477.124501:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820288 00000100:00100000:0.0:1788463477.124568:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788463477.124597:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485820288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463477.124641:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463477.124689:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485820288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463477.124697:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1788463477.124868:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463477.124910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485820288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463477.125607:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.125650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463477.125693:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.125719:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.125888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820800 00000100:00100000:1.0:1788463477.125895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820800 00000100:00100000:1.0:1788463477.125932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1788463477.125940:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485820800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.125981:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485820800:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.125997:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1788463477.126027:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821312 00000100:00100000:1.0:1788463477.126031:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821312 00000100:00100000:3.0:1788463477.126165:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485820544:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126193:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126213:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485821056:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126233:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126257:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485821568:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126277:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126296:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788463477.126302:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485820416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126328:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126359:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485820928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126384:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126401:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485821440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126420:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126436:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485821952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463477.126470:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.126498:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820544 00000100:00100000:3.0:1788463477.126501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820544 00000100:00100000:3.0:1788463477.126525:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821056 00000100:00100000:3.0:1788463477.126528:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821056 00000100:00100000:3.0:1788463477.126540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821568 00000100:00100000:3.0:1788463477.126543:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821568 00000100:00100000:3.0:1788463477.126556:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788463477.126562:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485820544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485820544:12345-0@lo:400:kworker.0 Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463477.126625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788463477.126638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1788463477.126644:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485821056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126669:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875339485821056:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463477.126675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1788463477.126686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788463477.126692:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485821568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463477.126719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485821568:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.126890:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821440 00000100:00100000:1.0:1788463477.126894:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821440 00000100:00100000:1.0:1788463477.126917:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463477.126924:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485821312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.126955:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485821312:12345-0@lo:400:kworker.0 Request processed in 33us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.126961:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463477.126972:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788463477.126977:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485821440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127000:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485821440:12345-0@lo:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.127006:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788463477.127269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820416 00000100:00100000:1.0:1788463477.127273:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820416 00000100:00100000:1.0:1788463477.127303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1788463477.127310:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485820416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127348:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485820416:12345-0@lo:400:kworker.0 Request processed in 38us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.127354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00080000:1.0:1788463477.127391:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463477.127395:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463477.127406:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485820672:0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127430:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.127463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485821184:0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127483:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.127496:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485821696:0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127515:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.127541:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820928 00000100:00100000:1.0:1788463477.127544:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820928 00000100:00100000:1.0:1788463477.127564:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485820672 00000100:00100000:1.0:1788463477.127566:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485820672 00000100:00100000:1.0:1788463477.127597:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788463477.127602:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485820928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127631:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485820928:12345-0@lo:400:kworker.0 Request processed in 29us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.127636:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788463477.127647:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788463477.127652:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.127675:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485820672:12345-0@lo:400:kworker.0 Request processed in 24us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.127680:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788463477.127692:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821184 00000100:00100000:1.0:1788463477.127701:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821184 00000100:00100000:1.0:1788463477.127723:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821696 00000100:00100000:1.0:1788463477.127725:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821696 00000100:00100000:0.0:1788463477.128091:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1788463477.128131:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1788463477.128207:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128216:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485821824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128241:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463477.128279:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821824 00000100:00100000:2.0:1788463477.128299:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821824 00000100:00100000:2.0:1788463477.128325:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788463477.128331:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485821824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128364:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485821824:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463477.128370:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788463477.128394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485821824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128421:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485821952 00000100:00100000:2.0:1788463477.128425:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485821952 00000100:00100000:2.0:1788463477.128464:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788463477.128472:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485821952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463477.128486:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788463477.128517:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485821952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463477.128522:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788463477.128569:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485820416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128598:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128620:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128635:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485821952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463477.128646:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485820544:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128656:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3651:1875339485821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788463477.128665:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485821568:0@lo:400:kworker.0 00000100:00080000:2.0:1788463477.128712:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463477.128715:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463477.128784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788463477.128823:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485820672:0@lo:400:kworker.0 00000100:00100000:0.0:1788463477.131188:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485821184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463477.131290:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485821184:12345-0@lo:400:kworker.0 Request processed in 3192us (3805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463477.131299:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00010000:00080000:3.0:1788463477.131460:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b2e300 x1875339485821184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463477.131475:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485821184:0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.131551:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485821696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463477.131715:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485821696:12345-0@lo:400:kworker.0 Request processed in 3577us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.131726:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00080000:3.0:1788463477.131740:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9618c1b2e680 x1875339485821696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463477.131750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485821696:0@lo:400:kworker.0 00000020:01000004:2.0:1788463477.256433:0:15065:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788463477.282142:0:15065:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788463477.282284:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282298:0:15065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282306:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282312:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282329:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788463477.282334:0:15065:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788463477.282361:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463477.282367:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282391:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463477.282394:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282403:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463477.282410:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463477.282417:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463477.282420:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788463477.282422:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788463477.282948:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.282957:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463477.283615:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.283626:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5600/0x841acb7f42a397a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397ab expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.283641:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463477.283644:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463477.283647:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463477.283671:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463477.283789:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463477.283882:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463477.283895:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788463477.283901:0:15065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788463477.283918:0:15065:0:(import.c:65:import_set_state_nolock()) ffff961891648000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788463477.283952:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485822208:0@lo:39:umount.0 00000100:00100000:1.0:1788463477.283991:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.284034:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822208 00000100:00100000:1.0:1788463477.284041:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822208 00000100:00100000:1.0:1788463477.284088:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788463477.284098:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875339485822208:12345-0@lo:39:umount.0 00000100:00100000:2.0:1788463477.284290:0:6552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822080 00000100:00100000:2.0:1788463477.284295:0:6552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822080 00000100:00100000:2.0:1788463477.284331:0:6552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463477.284337:0:6552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+24:3651:x1875339485822080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463477.284349:0:6552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463477.284366:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21800/0x841acb7f42a397ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a397a4 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463477.284378:0:6552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463477.284413:0:6552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3651:x1875339485822080:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463477.284420:0:6552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463477.284469:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822080:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788463477.284608:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39313 00000100:00080000:1.0:1788463477.284618:0:6523:0:(import.c:65:import_set_state_nolock()) ffff961882e06000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788463477.284680:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3647:x1875339485822208:12345-0@lo:39:umount.0 Request processed in 583us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.284688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788463477.284699:0:6523:0:(genops.c:885:class_export_put()) final put ffff9618ad1da000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788463477.284723:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463477.284765:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891648000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788463477.284776:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485822208:0@lo:39:umount.0 00000020:00000080:1.0:1788463477.284794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618ad1da000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788463477.284841:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961882e06000 for lustre-MDT0000 00000100:00080000:3.0:1788463477.285236:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463477.285240:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463477.285245:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788463477.286149:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286162:0:15065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286169:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286175:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286195:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463477.286201:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286224:0:15065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286231:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286236:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286251:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463477.286263:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463477.286269:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286277:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463477.286281:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286290:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463477.286298:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463477.286303:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463477.286305:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788463477.286330:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286346:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463477.286368:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286375:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21000/0x841acb7f42a397b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a397b9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286387:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463477.286391:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286397:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4c00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463477.286400:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463477.286403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485822336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.286409:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463477.286419:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463477.286423:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463477.286425:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788463477.286427:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788463477.286457:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286464:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463477.286470:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463477.286484:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463477.286494:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4c00/0x841acb7f42a396b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a396bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286504:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.286506:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.286508:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463477.286520:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485822464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463477.286565:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463477.286608:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822336 00000100:00100000:1.0:1788463477.286616:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822336 00000100:00100000:1.0:1788463477.286668:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463477.286677:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3648:x1875339485822336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463477.286688:0:9527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463477.286701:0:9527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4800/0x841acb7f42a397b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a397b2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463477.286714:0:9527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463477.286851:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.286899:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822464 00000100:00100000:3.0:1788463477.286903:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822464 00000100:00100000:3.0:1788463477.286932:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463477.286939:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+23:3649:x1875339485822464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.286947:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463477.286955:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207e800/0x841acb7f42a396bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a396b6 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.286967:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463477.286998:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3649:x1875339485822464:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463477.287005:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463477.287044:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485822464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.287074:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287084:0:15065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287102:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287107:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287120:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463477.287128:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463477.287133:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287140:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463477.287143:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287150:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463477.287158:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463477.287163:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788463477.287165:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788463477.287167:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788463477.287184:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287190:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463477.287205:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287218:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882813600/0x841acb7f42a39a0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a13 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287229:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.287232:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.287234:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463477.287241:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463477.287251:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463477.287278:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.287303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822592 00000100:00100000:3.0:1788463477.287308:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822592 00000100:00100000:3.0:1788463477.287332:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463477.287340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+22:3651:x1875339485822592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.287363:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463477.287373:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0ce00/0x841acb7f42a39a13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a39a0c expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287384:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463477.287411:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3651:x1875339485822592:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463477.287417:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463477.287451:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.287472:0:15065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.287481:0:15065:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288601:0:15065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288613:0:15065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288633:0:15065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463477.288637:0:15065:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788463477.288641:0:15065:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788463477.288684:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463477.288690:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288698:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961880030600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463477.288701:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288710:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463477.288717:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463477.288722:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463477.288725:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788463477.288726:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788463477.288753:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288759:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463477.288783:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288790:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880030600/0x841acb7f42a39272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39279 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288803:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.288805:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463477.288806:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463477.288819:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463477.288861:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463477.288898:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822720 00000100:00100000:3.0:1788463477.288904:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822720 00000100:00100000:3.0:1788463477.288942:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463477.288952:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+21:3651:x1875339485822720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463477.288962:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463477.288974:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207ea00/0x841acb7f42a39279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x841acb7f42a39272 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463477.288986:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463477.289018:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:760a69d7-d23f-4a71-8b75-cca21d577f9e+20:3651:x1875339485822720:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463477.289025:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463477.289057:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485822720:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1788463477.294717:0:15065:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788463477.294727:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788463477.294734:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463477.294740:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:3.0:1788463477.294749:0:15065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9618c1ad3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463477.294773:0:15065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff961786887000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463477.294778:0:15065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96188d3bc800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463477.294782:0:15065:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff96188f571000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788463477.294788:0:15065:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9618831e3380) has exports, disconnecting them 00000020:00080000:3.0:1788463477.294793:0:15065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9618c1ad3800), last request at 1788463477 00000020:00000080:3.0:1788463477.294801:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39623 00000100:00080000:3.0:1788463477.294823:0:15065:0:(import.c:65:import_set_state_nolock()) ffff9618c1ad1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788463477.294885:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9618c1ad3800): rc 0 00000020:00000080:3.0:1788463477.294888:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618c1ad3800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1788463477.294898:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788463477.294908:0:15065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff961786887000), last request at 1788463477 00000020:00000080:3.0:1788463477.294913:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39504 00000100:00080000:3.0:1788463477.294921:0:15065:0:(import.c:65:import_set_state_nolock()) ffff961786883800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788463477.294925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ad3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1788463477.294938:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788463477.294948:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961786887000): rc 0 00000020:00000080:3.0:1788463477.294950:0:15065:0:(genops.c:885:class_export_put()) final put ffff961786887000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788463477.294957:0:15065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96188d3bc800), last request at 1788463206 00000020:00000080:3.0:1788463477.294961:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a393fa 00000100:00080000:3.0:1788463477.294965:0:15065:0:(import.c:65:import_set_state_nolock()) ffff96188d3b9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788463477.294979:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463477.294979:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9618c1ad1800 for lustre-MDT0000 00000020:00000080:0.0:1788463477.294988:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961786887000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:3.0:1788463477.294990:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188d3bc800): rc 0 00000020:00000080:3.0:1788463477.294994:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188d3bc800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788463477.295000:0:15065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96188f571000), last request at 1788463206 00000020:00000080:3.0:1788463477.295004:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a393c9 00000100:00080000:3.0:1788463477.295007:0:15065:0:(import.c:65:import_set_state_nolock()) ffff96188f572800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788463477.295018:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786883800 for lustre-MDT0000 00000001:00000004:3.0:1788463477.295019:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00000080:0.0:1788463477.295025:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3bc800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788463477.295057:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188d3b9000 for lustre-MDT0000 00010000:00010000:0.0:1788463477.295067:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788463477.295107:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188f571000): rc 0 00000100:00100000:1.0:1788463477.295396:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3648:x1875339485822336:12345-0@lo:103:ldlm_bl.0 Request processed in 8718us (8912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463477.295408:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463477.295533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:3648:1875339485822336:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1788463477.296608:0:15065:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba47416a7ae0 00000100:00080000:3.0:1788463477.296646:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463477.296651:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788463477.299709:0:15065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788463477.299744:0:15065:0:(import.c:65:import_set_state_nolock()) ffff96188f7d3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788463477.300223:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485822848:0@lo:39:umount.0 00000100:00100000:1.0:1788463477.300305:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463477.300376:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822848 00000100:00100000:0.0:1788463477.300385:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822848 00000100:00100000:0.0:1788463477.300448:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788463477.300459:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485822848:12345-0@lo:39:umount.0 00000100:00080000:3.0:1788463477.300470:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788463477.300475:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000020:00000080:0.0:1788463477.300488:0:7732:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39455 00000100:00080000:0.0:1788463477.300495:0:7732:0:(import.c:65:import_set_state_nolock()) ffff96188f570800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463477.300520:0:7732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000004:00080000:3.0:1788463477.300646:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788463477.300664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463477.300711:0:15065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788463477.300725:0:15065:0:(import.c:65:import_set_state_nolock()) ffff96188d3ba800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788463477.300738:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463477.300740:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788463477.300752:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463477.300781:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3647:x1875339485822848:12345-0@lo:39:umount.0 Request processed in 323us (475us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788463477.300805:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:3.0:1788463477.300819:0:15065:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788463477.300833:0:15065:0:(import.c:65:import_set_state_nolock()) ffff961787d27800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788463477.300850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485822976:0@lo:9:umount.0 00000020:00080000:3.0:1788463477.300863:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9618831e3380) has no exports 00000100:00100000:0.0:1788463477.300880:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463477.300902:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485823104:0@lo:9:umount.0 00000100:00100000:0.0:1788463477.300922:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463477.300959:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f7d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788463477.300965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485822848:0@lo:39:umount.0 00000100:00100000:0.0:1788463477.300984:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485822976 00000100:00100000:0.0:1788463477.300988:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485822976 00000100:00100000:0.0:1788463477.301013:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823104 00000100:00100000:0.0:1788463477.301016:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823104 00000100:00100000:0.0:1788463477.301032:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788463477.301039:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485822976:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788463477.301052:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a395a5 00000100:00080000:0.0:1788463477.301058:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9617868f1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463477.301090:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788463477.301164:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1875339485822976:12345-0@lo:9:umount.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463477.301171:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788463477.301182:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788463477.301199:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875339485823104:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788463477.301210:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a396e7 00000100:00080000:0.0:1788463477.301215:0:8441:0:(import.c:65:import_set_state_nolock()) ffff961787d23800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463477.301234:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788463477.301298:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3647:x1875339485823104:12345-0@lo:9:umount.0 Request processed in 111us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463477.301312:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788463477.301502:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463477.301520:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d3ba800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1788463477.302170:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788463477.306351:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788463477.306368:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788463477.306375:0:7455:0:(genops.c:885:class_export_put()) final put ffff96188f575800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788463477.306393:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000001:00080000:2.0:1788463477.306400:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788463477.306402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f575800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788463477.306413:0:7455:0:(genops.c:885:class_export_put()) final put ffff961787255000/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d 00000004:00080000:0.0:1788463477.306599:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788463477.306605:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463477.306622:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485822976:0@lo:9:umount.0 00000100:00080000:0.0:1788463477.306663:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d27800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788463477.306673:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788463477.306675:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463477.306677:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485823104:0@lo:9:umount.0 00000001:00100000:2.0:1788463477.306898:0:7455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000001:00080000:2.0:1788463477.306906:0:7455:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788463477.306909:0:7455:0:(genops.c:885:class_export_put()) final put ffff961787c7a000/68497686-852f-43ff-8be6-586d5980ece4 00000001:00100000:0.0:1788463477.307712:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788463477.307717:0:9518:0:(genops.c:885:class_export_put()) final put ffff961787d27000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788463477.307887:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:0.0:1788463477.307891:0:9518:0:(genops.c:885:class_export_put()) final put ffff9618c1ae4000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:3.0:1788463477.312697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f570800 for lustre-MDT0001 00000001:00100000:3.0:1788463477.313769:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788463477.313775:0:8434:0:(genops.c:885:class_export_put()) final put ffff9617868f0000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788463477.313799:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:3.0:1788463477.313801:0:8434:0:(genops.c:885:class_export_put()) final put ffff961781da9000/68497686-852f-43ff-8be6-586d5980ece4 00000020:00000080:2.0:1788463477.314168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787255000/96cc6a8d-fff7-4ae3-8ac2-7122c9b0b56d for lustre-MDT0001 00000020:00080000:0.0:1788463477.314734:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9618831e3380) has no exports 00000020:00000080:2.0:1788463477.314787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787c7a000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-MDT0001 00000020:00000080:2.0:1788463477.318292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d27000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788463477.323527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ae4000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-OST0001 00000020:00000080:2.0:1788463477.323619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9617868f0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788463477.323651:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961781da9000/68497686-852f-43ff-8be6-586d5980ece4 for lustre-OST0000 00000020:00000080:2.0:1788463477.323676:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787257000 for lustre-MDT0001 00000020:00000080:2.0:1788463477.323682:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961786881000 for lustre-MDT0001 00000020:00000080:2.0:1788463477.323686:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787d23800 for lustre-OST0001 00000020:00000080:2.0:1788463477.323689:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787f94800 for lustre-OST0001 00000020:00000080:2.0:1788463477.323693:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617868f1800 for lustre-OST0000 00000020:00000080:2.0:1788463477.323696:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f414800 for lustre-OST0000 00000020:00000080:0.0:1788463477.364101:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a392cd 00000020:00000080:0.0:1788463477.364117:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188cece800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788463477.364141:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788463477.364232:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cece800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788463477.364262:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463477.364273:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788463477.364279:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff961884ff0000) has no exports 00000020:00000080:1.0:1788463477.364782:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a392c6 00000020:00000080:1.0:1788463477.364791:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188cecb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463477.364806:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cecb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788463477.364874:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463477.364882:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788463477.364885:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188433a800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788463477.364888:0:15065:0:(genops.c:844:class_export_destroy()) destroying export ffff96188433a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788463477.364892:0:15065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788463477.380120:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463477.636395:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463477.647345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485823232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463477.647444:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463477.655941:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823232 00000100:00100000:2.0:1788463477.655959:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823232 00000100:00100000:2.0:1788463477.656020:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788463477.656029:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875339485823232:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788463477.656039:0:6528:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788463477.657360:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1875339485823232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1325us (9910us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788463477.657372:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:02020000:0.0:1788463477.657523:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788463477.675055:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788463477.675080:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788463477.675086:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788463477.706959:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463477.708167:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 245 00000100:00080000:0.0:1788463477.708180:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96188d10b000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463477.708309:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787c2df80 x1875339485823360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463477.709858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485823360:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788463477.709933:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463477.710148:0:7732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823360 00000100:00100000:1.0:1788463477.710156:0:7732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823360 00000100:00100000:1.0:1788463477.710204:0:7732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788463477.710211:0:7732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485823360:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788463477.710230:0:7732:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788463477.718335:0:7732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1875339485823360:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 8115us (8393us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463477.718371:0:7732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1788463477.718696:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463477.718703:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463477.718708:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485823360:0@lo:38:ptlrpcd_00_01.0 00000040:00080000:3.0:1788463478.212830:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463478.404077:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463479.427761:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463480.451794:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463480.708566:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485823488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463480.708644:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463480.710643:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823488 00000100:00100000:3.0:1788463480.710657:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823488 00000100:00080000:1.0:1788463480.710741:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463480.711562:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788463480.711598:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485823488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463480.711636:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788463480.711736:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485823488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463480.711931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961882fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485823488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463480.712920:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00010000:0.0:1788463481.477302:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463482.244089:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788463482.244117:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788463482.244138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788463482.244142:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463482.244151:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:2.0:1788463482.244157:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463482.244164:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96188d10b000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463482.244191:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178700fb80 x1875339485823744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463482.244294:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463482.244310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485823872:0@lo:400:kworker.0 00000100:00100000:3.0:1788463482.244391:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463482.244471:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823872 00000100:00100000:3.0:1788463482.244478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823872 00000100:00100000:3.0:1788463482.244513:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788463482.244519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875339485823872:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788463482.244526:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788463482.244566:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875339485823872:12345-0@lo:400:kworker.0 Request processed in 45us (174us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788463482.244590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1788463482.244641:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788463482.244645:0:3650:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788463482.244649:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788463482.246493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485823744:0@lo:38:kworker.0 00000100:00100000:0.0:1788463482.246563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463482.246723:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463482.246733:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463482.246763:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463482.246791:0:13831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824000 00000100:00100000:0.0:1788463482.246798:0:13831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824000 00000100:00100000:0.0:1788463482.246877:0:13831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788463482.246887:0:13831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485824000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463482.246918:0:13831:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788463482.246957:0:13831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485824000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463482.246991:0:13831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1788463482.247018:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463482.247050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463482.247100:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823744 00000100:00100000:0.0:1788463482.247104:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823744 00000100:00100000:0.0:1788463482.247125:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788463482.247130:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485823744:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788463482.247144:0:6528:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788463482.255011:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485823616:0@lo:400:kworker.0 00000100:00100000:1.0:1788463482.255097:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463482.255205:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485823616 00000100:00100000:1.0:1788463482.255214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485823616 00000100:00100000:1.0:1788463482.255404:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1788463482.255415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3651:x1875339485823616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463482.255470:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b327cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:760a69d7-d23f-4a71-8b75-cca21d577f9e+19:3651:x1875339485823616:12345-0@lo:400:kworker.0 Request processed in 58us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463482.255477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1788463482.255524:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485823616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.257307:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485824512:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.257380:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.257417:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463482.257423:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485824128:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.257444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.257458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485824640:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.257474:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.257503:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824512 00000100:00100000:2.0:1788463482.257510:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824512 00000100:00100000:2.0:1788463482.257543:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824128 00000100:00100000:2.0:1788463482.257545:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824128 00000100:00100000:2.0:1788463482.257556:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824640 00000100:00100000:2.0:1788463482.257558:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824640 00000100:00100000:2.0:1788463482.257598:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788463482.257609:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.257653:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485824640:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463482.257659:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788463482.257674:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788463482.257678:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875339485824512:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788463482.257695:0:10067:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788463482.257719:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875339485824512:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788463482.257725:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788463482.257737:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788463482.257741:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875339485824128:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788463482.257745:0:10067:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788463482.257761:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1875339485824128:12345-0@lo:400:kworker.0 Request processed in 20us (317us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788463482.257766:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1788463482.257786:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463482.257812:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463482.257817:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788463482.257821:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788463482.257827:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463482.257844:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 267 00000100:00080000:2.0:1788463482.257850:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617868f3800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463482.257871:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618c1b2e680 x1875339485824768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463482.257891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485824128:0@lo:400:kworker.0 00010000:00080000:2.0:1788463482.257904:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700d500 x1875339485824640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463482.257914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485824640:0@lo:400:kworker.0 00000100:00080000:2.0:1788463482.257922:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463482.257929:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788463482.257932:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788463482.257935:0:3648:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463482.257938:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 290 00000100:00080000:2.0:1788463482.257942:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96188faf6800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463482.257953:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9618c1b2e300 x1875339485824896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463482.258179:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485824512:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.258214:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485824768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788463482.258242:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.258258:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485824896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788463482.258289:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.258311:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824768 00000100:00100000:2.0:1788463482.258314:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824768 00000100:00100000:2.0:1788463482.258327:0:10067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824896 00000100:00100000:2.0:1788463482.258330:0:10067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824896 00000100:00100000:2.0:1788463482.258350:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788463482.258355:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485824768:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788463482.258368:0:10067:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788463482.258396:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485824768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 39us (153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463482.258402:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788463482.258412:0:10067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788463482.258416:0:10067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485824896:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788463482.258421:0:10067:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788463482.258446:0:10067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875339485824896:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (157us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463482.258452:0:10067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1788463482.258477:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463482.258481:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463482.258483:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485824768:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788463482.258490:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463482.258492:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463482.258495:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485824896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788463482.261427:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485824384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463482.261505:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463482.261567:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463482.261604:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485824256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463482.261643:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463482.262405:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824384 00000100:00100000:2.0:1788463482.262416:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824384 00000100:00100000:2.0:1788463482.262495:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788463482.262509:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485824384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.262599:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485824384:12345-0@lo:400:kworker.0 Request processed in 71us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463482.262607:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1788463482.262691:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463482.262743:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485824384:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.262795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485824256 00000100:00100000:2.0:1788463482.262800:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485824256 00000100:00100000:2.0:1788463482.263022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1788463482.263029:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485824256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.263069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485824256:12345-0@lo:400:kworker.0 Request processed in 41us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463482.263074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00010000:00080000:2.0:1788463482.263106:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178700f800 x1875339485824256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463482.263117:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485824256:0@lo:400:kworker.0 00000100:00080000:3.0:1788463482.265985:0:3650:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463482.265996:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 245 00000100:00080000:3.0:1788463482.266007:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96188f417800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463482.266050:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa18380 x1875339485825024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463482.266077:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485823872:0@lo:400:kworker.0 00000100:00100000:2.0:1788463482.266611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485825024:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788463482.266697:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463482.267165:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825024 00000100:00100000:3.0:1788463482.267175:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825024 00000100:00100000:3.0:1788463482.267221:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788463482.267230:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485825024:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788463482.268216:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788463482.268757:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485825024:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1523us (2057us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788463482.268769:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788463482.268844:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463482.268850:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463482.268854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485825024:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788463482.269732:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463482.289010:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485823744:12345-0@lo:38:kworker.0 Request processed in 41869us (42437us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463482.289025:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1788463482.289079:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463482.289084:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463482.289088:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485823744:0@lo:38:kworker.0 00010000:00010000:2.0:1788463482.499752:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788463483.271525:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788463483.271538:0:6502:0:(genops.c:885:class_export_put()) final put ffff96188f571000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463483.272603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f571000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463483.287242:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f572800 for lustre-MDT0000 00000020:01000000:0.0:1788463483.460987:0:15065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787b1b8a0 - data ffff96188bf545e8/ffff961787073400 00000020:01000000:0.0:1788463483.461176:0:15065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9618864e1000 - data ffff96188bd2b870/ffff96188d100800 00000001:00000004:0.0:1788463483.471896:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00010000:00010000:2.0:1788463483.523812:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463483.558836:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788463483.558846:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788463483.558861:0:15065:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff96188fa18a80 x1875339485822848/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788463487 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463483.558891:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788463483.562353:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788463483.562361:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788463483.562373:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463483.562375:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788463483.565528:0:8829:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788463483.565535:0:8829:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788463483.565559:0:8829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788463483.566093:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463483.566098:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788463483.566118:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463483.566121:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788463483.567145:0:9853:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788463483.567150:0:9853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788463483.567160:0:9853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788463483.568366:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39295 00000020:00000080:0.0:1788463483.568376:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843fb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463483.568552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788463483.576780:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a392aa 00000020:00000080:0.0:1788463483.576795:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843f9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788463483.576812:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788463483.576817:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463483.576826:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788463483.576830:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9618831e19c0) has no exports 00000004:01000000:0.0:1788463483.576990:0:15065:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788463483.576997:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a396e0 00000020:00000080:0.0:1788463483.577001:0:15065:0:(genops.c:885:class_export_put()) final put ffff9617868f5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788463483.577005:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788463483.577008:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463483.577016:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463483.577019:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff961787c9b380) has no exports 00000020:00000080:0.0:1788463483.577025:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a396d9 00000020:00000080:0.0:1788463483.577028:0:15065:0:(genops.c:885:class_export_put()) final put ffff961787d22800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788463483.577389:0:15065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788463483.577394:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463483.577398:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788463483.577405:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463483.577407:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463483.577436:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463483.577443:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788463483.577449:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3959e 00000020:00000080:0.0:1788463483.577454:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618c1ad1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788463483.577457:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788463483.577461:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463483.577475:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463483.577491:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff96189165b380) has no exports 00000020:00000080:0.0:1788463483.577496:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39597 00000020:00000080:0.0:1788463483.577500:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188d3bf800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463483.577811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843f9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788463483.577820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9617868f5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788463483.577825:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787d22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788463483.577830:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787d27800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788463483.577837:0:8:0:(genops.c:885:class_export_put()) final put ffff961787c7a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463483.577839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787c7a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788463483.577843:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463483.577914:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ad1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788463483.577918:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3bf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788463483.578241:0:15065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788463483.578245:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788463483.578248:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788463483.578252:0:15065:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463483.578253:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463483.578671:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463483.578681:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788463483.578693:0:15065:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788463483.578699:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3944e 00000020:00000080:0.0:1788463483.578705:0:15065:0:(genops.c:885:class_export_put()) final put ffff96188f727000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463483.579769:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188d3ba800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788463483.579782:0:8:0:(genops.c:885:class_export_put()) final put ffff961781dad800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463483.579786:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961781dad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788463483.579794:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788463483.581774:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788463483.581789:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463483.581802:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463483.581807:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff96188d3a3380) has no exports 00000020:00000080:0.0:1788463483.581815:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39447 00000020:00000080:0.0:1788463483.581824:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843fd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463483.583336:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f727000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788463483.583352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788463483.584770:0:15065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788463483.584777:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788463483.584782:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788463483.584792:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463483.584846:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463483.584859:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463483.584886:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463483.584889:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463483.584894:0:15065:0:(genops.c:885:class_export_put()) final put ffff961882e00000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463483.584897:0:15065:0:(genops.c:844:class_export_destroy()) destroying export ffff961882e00000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788463483.584917:0:15065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463483.585014:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a392b1 00000020:00000080:1.0:1788463483.585021:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843fd000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788463483.585026:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788463483.585029:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463483.585034:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788463483.585037:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9618831e0000) has no exports 00000020:00000080:1.0:1788463483.585056:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463483.585059:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788463483.585063:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a392b8 00000020:00000080:1.0:1788463483.585066:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843fc800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788463483.585074:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618850d0800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788463483.585077:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618850d0800 3 00000020:01000004:1.0:1788463483.585080:0:15065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9618850d0800 from lustre-MDT0000 00000020:00000080:1.0:1788463483.585097:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463483.585101:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788463483.585103:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618843ff800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788463483.585106:0:15065:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843ff800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788463483.585112:0:15065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788463483.585139:0:15065:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788463483.585142:0:15065:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788463483.585145:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788463483.585147:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463483.585150:0:15065:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463483.585156:0:15065:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff96189164b000 760a69d7-d23f-4a71-8b75-cca21d577f9e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463483.585161:0:15065:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff961891658000) has exports, disconnecting them 00000020:00080000:1.0:1788463483.585165:0:15065:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96189164b000), last request at 1788463184 00000020:00000080:1.0:1788463483.585179:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3924f 00000020:00010000:1.0:1788463483.585183:0:15065:0:(genops.c:1921:obd_stale_export_put()) Put export ffff96189164b000: total 2 00000100:00080000:1.0:1788463483.585187:0:15065:0:(import.c:65:import_set_state_nolock()) ffff96189164e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788463483.585201:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96189164b000): rc 0 00000020:00080000:1.0:1788463483.585210:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff961891658000) has no exports 00000100:00100000:1.0:1788463483.585266:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff961884ac9400:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1788463483.585365:0:6518:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff961884ac8e00:6518] 2 exiting: rc = 0 00000100:00100000:1.0:1788463483.585414:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff961884ac9c00:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1788463483.585467:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585474:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585501:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585508:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585513:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585522:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585529:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585536:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585542:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585548:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585553:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585559:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585565:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585571:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585602:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585608:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585614:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585620:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585625:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585631:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585637:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788463483.585756:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f7d3800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788463483.585765:0:8:0:(genops.c:885:class_export_put()) final put ffff96188d3bb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788463483.585767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3bb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788463483.585775:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788463483.585845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788463483.585848:0:8:0:(genops.c:885:class_export_put()) final put ffff9618843fa000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788463483.585850:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fa000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788463483.585853:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788463483.585879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788463483.585917:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585924:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585931:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585936:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585943:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585949:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585954:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585960:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585965:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585980:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585986:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585992:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.585998:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586004:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586010:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586015:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586019:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586023:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586029:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586034:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586040:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586046:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586052:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586057:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586063:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586069:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586074:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586079:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586083:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586088:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586092:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586097:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586102:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586106:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586111:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586116:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586122:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586127:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586132:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586138:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586143:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586149:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463483.586154:0:15065:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788463483.593298:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961882813000/0x841acb7f42a39352 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a3934b expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593347:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813000/0x841acb7f42a39352 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a3934b expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593366:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961785e20e00/0x841acb7f42a39757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a39750 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593375:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20e00/0x841acb7f42a39757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a39750 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593384:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961785e21e00/0x841acb7f42a39765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a3975e expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593392:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21e00/0x841acb7f42a39765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a3975e expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593400:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9618be00ea00/0x841acb7f42a39773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a3976c expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593407:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618be00ea00/0x841acb7f42a39773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a3976c expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593415:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961785e21400/0x841acb7f42a39781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a3977a expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593422:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e21400/0x841acb7f42a39781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a3977a expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593429:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3978f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a39788 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593449:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5400/0x841acb7f42a3978f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a39788 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593457:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961785e20c00/0x841acb7f42a3979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a39796 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593464:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961785e20c00/0x841acb7f42a3979d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a39796 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593471:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a397c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a397c0 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593491:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a397c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a397c0 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593503:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9618c207e200/0x841acb7f42a39677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a39670 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593511:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c207e200/0x841acb7f42a39677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a39670 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593523:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961880031600/0x841acb7f42a39360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a39359 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593530:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961880031600/0x841acb7f42a39360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a39359 expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593540:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff96188f6f4400/0x841acb7f42a399e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a399e2 expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593558:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4400/0x841acb7f42a399e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a399e2 expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593566:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961787d0c000/0x841acb7f42a399f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a399f0 expref: 3 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593599:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c000/0x841acb7f42a399f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a399f0 expref: 3 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593609:0:15065:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff961786bde600/0x841acb7f42a39a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x841acb7f42a399fe expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463483.593617:0:15065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde600/0x841acb7f42a39a05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x841acb7f42a399fe expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788463483.597878:0:8455:0:(genops.c:1907:obd_stale_export_get()) Get export ffff96189164b000: total 0 00010000:00010000:1.0:1788463483.597954:0:8455:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff96189164b000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788463483.597971:0:8455:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff96189164b000, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1788463483.597979:0:8455:0:(genops.c:885:class_export_put()) final put ffff96189164b000/760a69d7-d23f-4a71-8b75-cca21d577f9e 00010000:00010000:1.0:1788463483.598008:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463483.598010:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463483.598012:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788463483.598057:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96189164b000/760a69d7-d23f-4a71-8b75-cca21d577f9e for MGS 00000020:00000080:2.0:1788463483.598107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96189164e000 for MGS 00010000:00010000:2.0:1788463484.548940:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463485.573348:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788463485.635738:0:15065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961785f6e3c0 - data ffff96188bf0d438/ffff9617878f1000 00000020:01000000:1.0:1788463485.635913:0:15065:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9618991d3360 - data ffff96188bc7a0d8/ffff961884f1c000 00000020:00000080:1.0:1788463485.636400:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3923a 00000020:00000080:1.0:1788463485.636409:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618b7cb9000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788463485.636434:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9618850d0800 from MGS, refs=2 00000020:01000004:1.0:1788463485.636438:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618850d0800 2 00000020:01000004:1.0:1788463485.636441:0:15065:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9618850d0800 from MGS 00000020:00000080:1.0:1788463485.636475:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463485.636481:0:15065:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788463485.636483:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cb9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788463485.636485:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618b7cbc000/MGS 00000020:00000080:1.0:1788463485.636490:0:15065:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbc000/MGS for MGS 00000020:01000000:1.0:1788463485.636498:0:15065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788463485.636559:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788463485.636563:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463485.636568:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463485.636619:0:15065:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9618ad1dc000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463485.636625:0:15065:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff96189165cd40) has exports, disconnecting them 00000020:00080000:1.0:1788463485.636629:0:15065:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9618ad1dc000), last request at 1788463184 00000020:00000080:1.0:1788463485.636633:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39305 00000020:00080000:1.0:1788463485.636643:0:15065:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9618ad1dc000): rc 0 00000020:00000080:1.0:1788463485.636646:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618ad1dc000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788463485.637633:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618ad1dc000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788463485.638842:0:15065:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788463485.638849:0:15065:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463485.638853:0:15065:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788463485.638859:0:15065:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463485.639044:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463485.639052:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788463485.639059:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9618850d0800 1 00000020:00000080:0.0:1788463485.639065:0:15065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3922c 00000020:00000080:0.0:1788463485.639072:0:15065:0:(genops.c:885:class_export_put()) final put ffff9618b7cbd800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788463485.639077:0:15065:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788463485.639084:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463485.639087:0:15065:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788463485.639101:0:15065:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9618831e4d40) has no exports 00000020:00000080:3.0:1788463485.641001:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961891648000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788463485.641016:0:36:0:(genops.c:885:class_export_put()) final put ffff9618ad1d8800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788463485.641029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618ad1d8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788463485.641034:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788463485.641109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9618b7cbd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788463485.696398:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463485.696414:0:15065:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788463485.696421:0:15065:0:(genops.c:885:class_export_put()) final put ffff961885e43800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788463485.696425:0:15065:0:(genops.c:844:class_export_destroy()) destroying export ffff961885e43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788463485.696432:0:15065:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788463485.696559:0:15065:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9618850d5000 00000020:02000400:2.0:1788463485.696859:0:15065:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788463485.828020:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485825152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463485.828094:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463485.828371:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825152 00000100:00100000:0.0:1788463485.828380:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825152 00000100:00100000:0.0:1788463485.828446:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788463485.828456:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485825152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463485.828485:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788463485.828532:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485825152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463485.828539:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1788463485.828798:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463485.828845:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485825152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788463486.596815:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463487.363872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463487.363879:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463487.363883:0:8:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463487.363891:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788463487.363897:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463487.363904:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96188d10b000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463487.363928:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa18700 x1875339485825408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463487.363949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463487.363952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463487.363964:0:8:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463487.363968:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788463487.363971:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463487.363974:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96188f417800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463487.363988:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1b480 x1875339485825536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463487.363997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463487.364000:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463487.364001:0:8:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463487.364004:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788463487.364006:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463487.364010:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617868f3800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463487.364021:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1bb80 x1875339485825664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463487.364046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463487.364050:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463487.364051:0:8:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463487.364054:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788463487.364056:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463487.364060:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96188faf6800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463487.364069:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1aa00 x1875339485826048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463487.364103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485825408:0@lo:38:kworker.0 00000100:00100000:3.0:1788463487.364170:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463487.364223:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485825536:0@lo:38:kworker.0 00000100:00100000:3.0:1788463487.364259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463487.364274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485825664:0@lo:38:kworker.0 00000100:00100000:3.0:1788463487.364295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463487.364311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485826048:0@lo:38:kworker.0 00000100:00100000:3.0:1788463487.364333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463487.364349:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485825280:0@lo:400:kworker.0 00000400:00000100:1.0:1788463487.364377:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485825280 offset 0 length 224: 4 00000100:00100000:1.0:1788463487.364402:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485826304:0@lo:400:kworker.0 00000100:00100000:2.0:1788463487.364408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485826176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463487.364449:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463487.364454:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463487.364500:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825408 00000100:00100000:2.0:1788463487.364507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485825792:0@lo:400:kworker.0 00000100:00100000:1.0:1788463487.364508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825408 00000100:00100000:2.0:1788463487.364541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463487.364544:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788463487.364552:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485825408:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788463487.364567:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00020000:1.0:1788463487.364590:0:6527:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788463487.364607:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485825920:0@lo:400:kworker.0 00000100:00100000:1.0:1788463487.364638:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485825408:12345-0@lo:38:kworker.0 Request processed in 84us (466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463487.364645:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463487.364652:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788463487.364690:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825536 00000100:00100000:2.0:1788463487.364696:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825536 00000100:00100000:2.0:1788463487.364715:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825664 00000100:00100000:2.0:1788463487.364718:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825664 00000100:00100000:2.0:1788463487.364726:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826048 00000100:00100000:2.0:1788463487.364729:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826048 00000100:00100000:2.0:1788463487.364738:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826176 00000100:00100000:2.0:1788463487.364740:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826176 00000100:00100000:2.0:1788463487.364768:0:12162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825792 00000100:00100000:2.0:1788463487.364771:0:12162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825792 00000100:00100000:2.0:1788463487.364792:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788463487.364797:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826304 00000100:00100000:2.0:1788463487.364800:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485826176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463487.364811:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826304 00000100:00100000:2.0:1788463487.364851:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485826176:12345-0@lo:400:kworker.0 Request processed in 52us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463487.364860:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788463487.364861:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485825920 00000100:00100000:1.0:1788463487.364865:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485825920 00000100:00100000:2.0:1788463487.364891:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1788463487.364895:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463487.364901:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485825792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463487.364908:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485826304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463487.365180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788463487.365185:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485825536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788463487.365196:0:6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788463487.365236:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485825792:12345-0@lo:400:kworker.0 Request processed in 338us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463487.365252:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1788463487.365263:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485826304:12345-0@lo:400:kworker.0 Request processed in 359us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463487.365270:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788463487.365273:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463487.365277:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485825664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788463487.365290:0:12162:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463487.365294:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788463487.365303:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485825920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463487.365327:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485825664:12345-0@lo:38:kworker.0 Request processed in 50us (1029us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463487.365334:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788463487.365342:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485825920:12345-0@lo:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463487.365351:0:12162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788463487.365359:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463487.365361:0:12162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485826048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788463487.365373:0:12162:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463487.365404:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485826304:0@lo:400:kworker.0 00000100:00100000:2.0:1788463487.365406:0:12162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3647:x1875339485826048:12345-0@lo:38:kworker.0 Request processed in 45us (1071us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463487.365413:0:12162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788463487.365441:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463487.365444:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463487.365445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788463487.365462:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff96188fa19500 x1875339485826176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463487.365472:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485826176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463487.365489:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463487.365563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485825536:12345-0@lo:38:kworker.0 Request processed in 376us (1302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788463487.365569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1788463487.365607:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463487.365611:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463487.365614:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485825408:0@lo:38:kworker.0 00000100:00080000:3.0:1788463487.365623:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463487.365627:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463487.365631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485825536:0@lo:38:kworker.0 00000100:00080000:3.0:1788463487.365639:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463487.365643:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463487.365645:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485825664:0@lo:38:kworker.0 00000100:00080000:3.0:1788463487.365652:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463487.365655:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463487.365658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485826048:0@lo:38:kworker.0 00000100:00100000:2.0:1788463487.365885:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485826432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463487.365930:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463487.365977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485825920:0@lo:400:kworker.0 00010000:00080000:2.0:1788463487.365988:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff96188fa1a680 x1875339485825792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463487.365996:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485825792:0@lo:400:kworker.0 00000100:00100000:3.0:1788463487.366737:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826432 00000100:00100000:3.0:1788463487.366747:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826432 00000100:00100000:3.0:1788463487.366803:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788463487.366812:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485826432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463487.366843:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788463487.366907:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485826432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463487.366914:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788463487.366958:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485826432:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788463487.620291:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463488.452208:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463488.644750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463489.667873:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788463489.765793:0:15268:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788463489.790079:0:15268:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788463489.791281:0:15268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.791301:0:15268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.791309:0:15268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.791317:0:15268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.791337:0:15268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463489.791345:0:15268:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788463489.791387:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463489.791393:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463489.791401:0:15268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463489.791431:0:15268:0:(import.c:65:import_set_state_nolock()) ffff96188f417800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788463489.791439:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463489.791441:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463489.791445:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788463489.791830:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463489.791840:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.791850:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463489.791854:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.791864:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463489.791872:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463489.791878:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463489.791880:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788463489.791883:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788463489.791948:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.791955:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463489.791985:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.792002:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e20a00/0x841acb7f42a39788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3978f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.792019:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463489.792021:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463489.792023:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463489.792648:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485826560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463489.796363:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463489.797067:0:15268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797085:0:15268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797092:0:15268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797099:0:15268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797127:0:15268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463489.797133:0:15268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797140:0:15268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797147:0:15268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797153:0:15268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797242:0:15268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463489.797269:0:15268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797277:0:15268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797283:0:15268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797290:0:15268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797305:0:15268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788463489.797312:0:15268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797320:0:15268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797327:0:15268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797335:0:15268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463489.797342:0:15268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788463489.797345:0:15268:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788463489.797381:0:15268:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788463489.797386:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788463489.797391:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463489.797398:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788463489.797410:0:15268:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff96188f411000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463489.797417:0:15268:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff961781dae800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463489.797424:0:15268:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff96188d3a4d40) has exports, disconnecting them 00000020:00080000:3.0:1788463489.797430:0:15268:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96188f411000), last request at 1788463487 00000020:00000080:3.0:1788463489.797440:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39638 00000100:00080000:3.0:1788463489.797465:0:15268:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788463489.797518:0:15268:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188f411000): rc 0 00000020:00000080:3.0:1788463489.797521:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188f411000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788463489.797531:0:15268:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff961781dae800), last request at 1788463487 00000020:00000080:3.0:1788463489.797534:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39512 00000100:00080000:3.0:1788463489.797543:0:15268:0:(import.c:65:import_set_state_nolock()) ffff961781da8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788463489.797550:0:15268:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961781dae800): rc 0 00000020:00000080:3.0:1788463489.797552:0:15268:0:(genops.c:885:class_export_put()) final put ffff961781dae800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788463489.797561:0:15268:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffba474192bae0 00000100:00100000:0.0:1788463489.798963:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826560 00000100:00100000:0.0:1788463489.798982:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826560 00000100:00100000:0.0:1788463489.799057:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463489.799069:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875339485826560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788463489.799079:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463489 with bad export cookie 9519144509840265807 00010000:00010000:2.0:1788463489.800062:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788463489.800103:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800120:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463489.800126:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800138:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463489.800147:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463489.800153:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463489.800156:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788463489.800168:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788463489.800227:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800234:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463489.800279:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800287:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a39796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a3979d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800307:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788463489.800311:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800318:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4e00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463489.800320:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.800328:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463489.800334:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463489.800425:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463489.800438:0:15268:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff96178700f480 x1875339485823232/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788463493 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463489.800565:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 10000000:01000000:2.0:1788463489.801168:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463489.801172:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788463489.801174:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788463489.801215:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801222:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463489.801555:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801565:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4e00/0x841acb7f42a39670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39677 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801631:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463489.801639:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801645:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463489.801649:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801725:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463489.801732:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463489.801738:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788463489.801741:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788463489.801743:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788463489.801764:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801770:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463489.801793:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801800:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5800/0x841acb7f42a399fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39a05 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801811:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463489.801815:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801827:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c207fc00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463489.801830:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801838:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463489.801845:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463489.801850:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463489.801854:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788463489.801856:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788463489.801870:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801877:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463489.801883:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801890:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c207fc00/0x841acb7f42a39359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x841acb7f42a39360 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463489.801904:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463489.801906:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463489.801909:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463489.801941:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485826688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463489.802040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463489.802207:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463489.802225:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485826816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463489.802258:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463489.802308:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826688 00000100:00100000:1.0:1788463489.802317:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826688 00000100:00100000:1.0:1788463489.802373:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485826816 00000100:00100000:1.0:1788463489.802376:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485826816 00000100:00100000:1.0:1788463489.802396:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463489.802403:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618b7cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1875339485826688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788463489.802410:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463489 with bad export cookie 9519144509840265807 00000100:00100000:1.0:1788463489.802463:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618b7cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1875339485826688:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (423us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788463489.802486:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463489.802505:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463489.802510:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3651:x1875339485826816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788463489.802514:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463489 with bad export cookie 9519144509840265807 00000100:00100000:1.0:1788463489.802544:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3651:x1875339485826816:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (285us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788463489.802550:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788463489.805727:0:15268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463489.805739:0:15268:0:(import.c:65:import_set_state_nolock()) ffff96188d10b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788463489.805813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f411000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788463489.805874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961781dae800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788463489.805896:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f415800 for lustre-MDT0001 00000020:00000080:3.0:1788463489.805901:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781da8000 for lustre-MDT0001 00010000:00010000:3.0:1788463489.805913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463489.805936:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485827072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463489.806011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463489.809889:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463489.809919:0:3650:0:(import.c:65:import_set_state_nolock()) ffff961886ddc000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788463489.809927:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788463489.810097:0:9527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485827072 00000100:00100000:1.0:1788463489.810109:0:9527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485827072 00000100:00100000:1.0:1788463489.810182:0:9527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463489.810202:0:9527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1875339485827072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788463489.810210:0:9527:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463489 with bad export cookie 9519144509840265807 00000100:00100000:1.0:1788463489.810319:0:9527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3649:x1875339485827072:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (4307us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788463489.810330:0:9527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788463489.810398:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788463489.810436:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788463489.810445:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788463489.810473:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788463489.810749:0:15268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788463489.810778:0:15268:0:(import.c:65:import_set_state_nolock()) ffff96188f997800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788463489.810793:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463489.810796:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788463489.810804:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463489.810876:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485827200:0@lo:9:umount.0 00000100:00100000:3.0:1788463489.810937:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788463489.810980:0:15268:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788463489.810990:0:15268:0:(import.c:65:import_set_state_nolock()) ffff961787c78000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788463489.811004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485827328:0@lo:9:umount.0 00000100:00100000:3.0:1788463489.811025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788463489.811185:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96188d3a4d40) has no exports 00000100:00100000:0.0:1788463489.816431:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3649:x1875339485826560:12345-0@lo:103:ldlm_bl.0 Request processed in 17352us (20062us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788463489.816448:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788463489.816704:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788463489.832670:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.153@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788463489.832678:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788463489.832691:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188fa18380 x1875339485825280/t0(0) o400->MGC192.168.204.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788463503 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463489.832709:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618c1b2f480 x1875339485826560/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463505 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463489.832720:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618c1b2ce00 x1875339485826688/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463505 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463489.832731:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9618c1b2f800 x1875339485826816/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463505 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463489.832740:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188fa1b800 x1875339485827072/t0(0) o103->MGC192.168.204.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463505 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788463489.832750:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788463489.832754:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788463489.832755:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788463489.833435:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff961886ddc000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788463489.833470:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485825280:0@lo:400:kworker.0 00000100:00100000:1.0:1788463489.833569:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:760a69d7-d23f-4a71-8b75-cca21d577f9e:3651:1875339485826816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463489.833624:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485827200 00000100:00100000:1.0:1788463489.833634:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485827200 00000100:00100000:3.0:1788463489.833650:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:760a69d7-d23f-4a71-8b75-cca21d577f9e:0:1875339485826944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463489.833761:0:9857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485827328 00000100:00100000:1.0:1788463489.833765:0:9857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485827328 00000100:00100000:1.0:1788463489.833788:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788463489.833797:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875339485827200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788463489.833851:0:9857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3955f 00000100:00080000:1.0:1788463489.833861:0:9857:0:(import.c:65:import_set_state_nolock()) ffff961781daa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463489.833912:0:9857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788463489.834359:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875339485827200:12345-0@lo:9:umount.0 Request processed in 561us (23420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463489.834367:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788463489.834385:0:9857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788463489.834391:0:9857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875339485827328:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788463489.834403:0:9857:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a396a1 00000100:00080000:1.0:1788463489.834410:0:9857:0:(import.c:65:import_set_state_nolock()) ffff961787c7e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463489.834433:0:9857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788463489.834750:0:9857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3647:x1875339485827328:12345-0@lo:9:umount.0 Request processed in 358us (23722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463489.834758:0:9857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788463489.834878:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463489.834884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463489.834904:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463489.834949:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787c78000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788463489.834967:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788463489.834969:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463489.834977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485827328:0@lo:9:umount.0 00000100:00080000:1.0:1788463489.834991:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f997800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788463489.835047:0:3647:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788463489.835049:0:3647:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463489.835052:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485827200:0@lo:9:umount.0 00010000:00010000:1.0:1788463489.835080:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463489.835317:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff961886ddc000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788463489.835334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485826560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463489.835342:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485823232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463489.835361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:760a69d7-d23f-4a71-8b75-cca21d577f9e:3649:1875339485827072:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788463489.836115:0:3650:0:(import.c:65:import_set_state_nolock()) ffff961886ddc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463489.836125:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 223 00000100:00080000:2.0:1788463489.836135:0:3650:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961886ddc000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463489.841405:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1aa00 x1875339485827456/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463489.841469:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:760a69d7-d23f-4a71-8b75-cca21d577f9e:3650:1875339485826688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463489.842025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485827456:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788463489.842111:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485827456 offset 0 length 520: 4 00000020:00080000:3.0:1788463489.857083:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff96188d3a4d40) has no exports 00000020:01000000:2.0:1788463489.930907:0:15268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96188f7a6f00 - data ffff96188bf0dd80/ffff9617878f2000 00000020:01000000:2.0:1788463489.931130:0:15268:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff96188ce968a0 - data ffff96188bd4bd80/ffff961891f31400 00000001:00000004:2.0:1788463489.943732:0:15268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788463489.995961:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463489.995971:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788463489.995979:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788463489.997531:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788463489.997538:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788463489.997637:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463489.997640:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788463489.998454:0:8824:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788463489.998460:0:8824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788463489.998473:0:8824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788463489.999285:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463489.999292:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788463489.999315:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463489.999319:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788463489.999771:0:9845:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788463489.999782:0:9845:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788463489.999792:0:9845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788463490.002094:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3937c 00000020:00000080:3.0:1788463490.002106:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188cece000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463490.002560:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cece000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463490.008867:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39391 00000020:00000080:3.0:1788463490.008881:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d3b8000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788463490.008903:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788463490.008908:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463490.008917:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788463490.008922:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff96188d3a0000) has no exports 00000020:00000080:0.0:1788463490.009439:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3b8000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788463490.009510:0:15268:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788463490.009520:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3969a 00000020:00000080:3.0:1788463490.009525:0:15268:0:(genops.c:885:class_export_put()) final put ffff961781dab000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788463490.009540:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788463490.009545:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463490.009553:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788463490.009556:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff96188f6019c0) has no exports 00000020:00000080:3.0:1788463490.009563:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39693 00000020:00000080:3.0:1788463490.009567:0:15268:0:(genops.c:885:class_export_put()) final put ffff961787c79800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788463490.009957:0:15268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788463490.009962:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463490.009967:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788463490.009973:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463490.009976:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463490.010005:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463490.010013:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463490.010017:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39558 00000020:00000080:3.0:1788463490.010022:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188f995800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788463490.010025:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788463490.010028:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463490.010032:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788463490.010035:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff96188f9b8000) has no exports 00000020:00000080:3.0:1788463490.010039:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39551 00000020:00000080:3.0:1788463490.010041:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188f992800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463490.010315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961781dab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788463490.010323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787c79800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788463490.010328:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787c78000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788463490.010336:0:8:0:(genops.c:885:class_export_put()) final put ffff961787250000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788463490.010338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787250000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788463490.010342:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463490.010424:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f995800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788463490.010429:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f992800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788463490.011127:0:15268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788463490.011132:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788463490.011135:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788463490.011140:0:15268:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463490.011142:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463490.011178:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463490.011186:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788463490.011207:0:15268:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788463490.011212:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a393b4 00000020:00000080:1.0:1788463490.011219:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188cedd000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788463490.011225:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788463490.011230:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463490.011235:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788463490.011239:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9618916599c0) has no exports 00000020:00000080:1.0:1788463490.011244:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a393ad 00000020:00000080:1.0:1788463490.011248:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d10d000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463490.012475:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f997800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788463490.012498:0:8:0:(genops.c:885:class_export_put()) final put ffff961786885800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788463490.012502:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961786885800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788463490.012509:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463490.012616:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788463490.012622:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d10d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788463490.014715:0:15268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788463490.014723:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463490.014728:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788463490.014736:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463490.014794:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463490.014805:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463490.014834:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463490.014837:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463490.014842:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d0e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788463490.014846:0:15268:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d0e8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788463490.014865:0:15268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788463490.015048:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39398 00000020:00000080:0.0:1788463490.015056:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d3b9800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788463490.015061:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788463490.015065:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463490.015070:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788463490.015074:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff96188d3a19c0) has no exports 00000020:00000080:0.0:1788463490.015108:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463490.015112:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788463490.015117:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3939f 00000020:00000080:0.0:1788463490.015121:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d3bb800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788463490.015128:0:15268:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188d0ea000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788463490.015132:0:15268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188d0ea000 2 00000020:01000004:0.0:1788463490.015135:0:15268:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96188d0ea000 from lustre-MDT0001 00000020:00000080:0.0:1788463490.015154:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463490.015157:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788463490.015160:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188cecb000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788463490.015162:0:15268:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cecb000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788463490.015170:0:15268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788463490.015210:0:15268:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788463490.015214:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788463490.015218:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463490.015221:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788463490.015229:0:15268:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff96188f413000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463490.015235:0:15268:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff96188f603380) has exports, disconnecting them 00000020:00080000:0.0:1788463490.015241:0:15268:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff96188f413000), last request at 1788463206 00000020:00000080:0.0:1788463490.015245:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a393f3 00000020:00080000:0.0:1788463490.015259:0:15268:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188f413000): rc 0 00000020:00000080:0.0:1788463490.015263:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188f413000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788463490.016000:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188d10b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788463490.016019:0:8:0:(genops.c:885:class_export_put()) final put ffff96188d10e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463490.016022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d10e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788463490.016032:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463490.016175:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3b9800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788463490.016180:0:8:0:(genops.c:885:class_export_put()) final put ffff9618843fe000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788463490.016182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618843fe000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788463490.016185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788463490.016379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d3bb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463490.016384:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f413000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788463490.039663:0:15268:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788463490.039673:0:15268:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463490.039677:0:15268:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788463490.039685:0:15268:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463490.039719:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f417800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788463490.039907:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463490.039916:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788463490.039921:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188f414000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788463490.039925:0:15268:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f414000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788463490.039934:0:15268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788463490.040005:0:15268:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188d0ea000 1 00000020:00000080:3.0:1788463490.040011:0:15268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3932f 00000020:00000080:3.0:1788463490.040017:0:15268:0:(genops.c:885:class_export_put()) final put ffff9618a5fae000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788463490.040025:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788463490.040033:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618a5fae000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788463490.040042:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463490.040047:0:15268:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463490.040051:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff961884ff4d40) has no exports 00000020:00000080:0.0:1788463490.599936:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463490.599951:0:15268:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788463490.599969:0:15268:0:(genops.c:885:class_export_put()) final put ffff96188d0e9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788463490.599973:0:15268:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d0e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788463490.599987:0:15268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788463490.600108:0:15268:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188d0ed000 00000020:01000000:0.0:1788463490.600136:0:15268:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788463490.600140:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463490.600145:0:15268:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788463490.600149:0:15268:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff961884ff3380) has no exports 00000100:00100000:3.0:1788463490.600342:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff961889dffa00:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1788463490.600447:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff961889dffe00:6524] 2 exiting: rc = 0 00000100:00100000:2.0:1788463490.600930:0:12162:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9617868b1e00:12162] 4 exiting: rc = 0 00000100:00100000:2.0:1788463490.601008:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff961889dffc00:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1788463490.601138:0:10067:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff961787d75800:10067] 3 exiting: rc = 0 00000100:00100000:0.0:1788463490.601802:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601811:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601817:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601824:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601830:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601835:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601852:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601859:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601865:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601872:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601878:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601884:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601890:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601895:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601900:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601905:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601911:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601917:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601923:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601930:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601936:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601940:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601947:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601953:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601959:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601965:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601981:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601986:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601992:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.601998:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602003:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602009:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602014:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602019:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602024:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602030:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602035:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602041:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602046:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602052:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602058:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602064:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602070:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602076:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602081:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602086:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602092:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602098:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602103:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602109:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602115:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602120:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602126:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602131:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602137:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602144:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602150:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602156:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602161:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602167:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602173:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602538:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602546:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.602552:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.613938:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96189430f800:6525] 0 exiting: rc = 1 00000100:00100000:1.0:1788463490.615699:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96189430e200:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1788463490.615823:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615832:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615839:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615846:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615852:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615858:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615863:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615870:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615875:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615881:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615886:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615893:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615899:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615905:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615910:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615915:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615920:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615925:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615930:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615936:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615941:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615946:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615952:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615957:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615962:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615967:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615973:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615978:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615983:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615987:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615991:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.615996:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616019:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616024:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616031:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616036:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616040:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616046:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616051:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616056:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616060:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616065:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616070:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616075:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616080:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616085:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616090:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616096:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616101:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616106:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616111:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616117:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616123:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616128:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616133:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616139:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616144:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616148:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616153:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616157:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616162:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616167:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616172:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616187:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.616913:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff961891e13c00:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1788463490.617059:0:7732:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff96188f73bc00:7732] 2 exiting: rc = 0 00000100:00100000:1.0:1788463490.617134:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96189430f000:6527] 0 exiting: rc = 1 00000100:00100000:0.0:1788463490.617450:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617459:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617477:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617483:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617489:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617504:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617509:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617521:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617528:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617534:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617540:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617546:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617551:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617563:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617569:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617597:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617603:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617610:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617616:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617634:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617640:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617646:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617652:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617658:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617664:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617669:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617675:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617681:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617687:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617693:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617699:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617715:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617721:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617726:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617732:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617738:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617744:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617755:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617760:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617766:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617772:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617777:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617782:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617801:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617808:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617814:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617820:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617826:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617832:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617839:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617845:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617850:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617856:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617862:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617868:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617887:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617894:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617900:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617906:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617911:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617916:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617921:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617927:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788463490.617933:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.635009:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9618915e6a00:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1788463490.639990:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9618915e7a00:6530] 1 exiting: rc = 0 00000100:00100000:3.0:1788463490.641017:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641026:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641031:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641036:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641041:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641046:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641052:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641058:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641064:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641070:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641077:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641083:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641089:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641095:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641101:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641107:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641113:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641119:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641124:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641132:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641141:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641148:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641153:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641157:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641163:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641168:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641174:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641327:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641332:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641337:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641342:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641348:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641354:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641359:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641380:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641385:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641390:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641395:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641399:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641405:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641409:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641414:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641419:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641424:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641428:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641433:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641439:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641443:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641449:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641454:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641458:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641463:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641467:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641472:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641477:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641482:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641487:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641491:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641495:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641500:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641504:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641508:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641512:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.641517:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642017:0:7734:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0002: service thread [ffff96188f708000:7734] 2 exiting: rc = 0 00000100:00100000:3.0:1788463490.642122:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9618915e6400:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1788463490.642175:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9618ad140600:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1788463490.642449:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642455:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642460:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642486:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642492:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642498:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642503:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642508:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642513:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642518:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.642523:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643650:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643656:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643662:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643667:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643672:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643678:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643683:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643689:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643694:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643700:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643706:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643711:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643716:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643722:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643727:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643733:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643739:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643745:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643750:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643755:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643761:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643766:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643772:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643778:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643784:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643789:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643795:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643814:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643820:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643825:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643830:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643836:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643841:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643847:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643853:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643859:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643864:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643869:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643875:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643880:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643886:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643891:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643896:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643901:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643906:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643911:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643916:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643921:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643926:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643931:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643936:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643941:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.643946:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.644639:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9618ad141a00:6533] 0 exiting: rc = 1 00000100:00100000:1.0:1788463490.644931:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9618ad140c00:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1788463490.645499:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645507:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645512:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645518:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645525:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645541:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645547:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645552:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645557:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645688:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645697:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645703:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645707:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645713:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645719:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645724:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645729:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645735:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645740:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645746:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645751:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645757:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645762:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645768:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645772:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645778:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645783:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645788:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645793:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645798:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645803:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645808:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645814:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645819:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645825:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645831:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645836:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645841:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645846:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645851:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645855:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645861:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645866:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645871:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645884:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645888:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645893:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645898:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645904:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645908:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645914:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645919:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645924:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645929:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645935:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645943:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645947:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645952:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645957:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645961:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645966:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645971:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645975:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.645981:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463490.650123:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9618ad141c00:6537] 2 exiting: rc = 0 00000100:00100000:2.0:1788463490.650469:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9618915e7200:6536] 1 exiting: rc = 0 00000100:00100000:1.0:1788463490.659441:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9618915e7600:6535] 0 exiting: rc = 1 00000100:00100000:2.0:1788463490.659555:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659566:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659608:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659619:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659627:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659633:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659651:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659658:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659664:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659670:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659676:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659682:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659698:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659706:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659712:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659719:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659724:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659730:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659736:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659742:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659747:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659754:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659759:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659765:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659770:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659776:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659782:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659788:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659795:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659812:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659818:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659824:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659830:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659836:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659841:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659847:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659867:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659874:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659880:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659885:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659891:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659896:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659902:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659908:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659914:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659920:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659926:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659932:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659938:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659943:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659949:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659955:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659961:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659967:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659973:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659978:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659985:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659990:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.659996:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.660003:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.660019:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.660029:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.660042:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463490.660053:0:15268:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788463490.667899:0:15268:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463490.667911:0:15268:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788463490.667916:0:15268:0:(genops.c:885:class_export_put()) final put ffff96189164f000/MDS_uuid 00000020:00000080:2.0:1788463490.667921:0:15268:0:(genops.c:844:class_export_destroy()) destroying export ffff96189164f000/MDS_uuid for MDS 00000020:01000000:2.0:1788463490.667925:0:15268:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788463490.668055:0:15268:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788463490.701761:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463491.716113:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463492.484022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463492.484035:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463492.484039:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463492.484043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463492.484048:0:36:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463492.484058:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1788463492.484064:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463492.484073:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617868f3800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463492.484779:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1a680 x1875339485827584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463492.485551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463492.485560:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788463492.485564:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788463492.485564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485827584:0@lo:38:kworker.0 00000400:00000100:0.0:1788463492.485659:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485827584 offset 0 length 520: 4 00000100:00080000:3.0:1788463492.485771:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1788463492.485777:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463492.485784:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96188faf6800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463492.485808:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e19500 x1875339485827840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463492.486805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485827840:0@lo:38:kworker.0 00000400:00000100:0.0:1788463492.486864:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485827840 offset 0 length 520: 4 00000100:00100000:0.0:1788463492.487915:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485827968:0@lo:400:kworker.0 00000100:00100000:3.0:1788463492.487929:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485827712:0@lo:400:kworker.0 00000400:00000100:0.0:1788463492.490051:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485827968 offset 0 length 224: 4 00000400:00000100:3.0:1788463492.490222:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485827712 offset 0 length 224: 4 00010000:00010000:1.0:1788463492.747379:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463493.765025:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463494.787768:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463495.493999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463495.494015:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463495.494018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463495.494021:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463495.494139:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788463495.494178:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463495.494182:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463495.494239:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463495.494266:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485828224:0@lo:400:kworker.0 00000400:00000100:3.0:1788463495.494340:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828224 offset 0 length 224: 4 00000100:00100000:2.0:1788463495.495632:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485828096:0@lo:400:kworker.0 00000400:00000100:2.0:1788463495.495772:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828096 offset 0 length 224: 4 00000020:01000004:0.0:1788463495.522290:0:15469:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788463495.548019:0:15469:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788463495.548113:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463495.548131:0:15469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463495.548139:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463495.548147:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463495.548189:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463495.548197:0:15469:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788463495.548227:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463495.548244:0:15469:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e1a680 x1875339485827584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463495.548271:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463495.548279:0:15469:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463495.548288:0:15469:0:(import.c:65:import_set_state_nolock()) ffff9617868f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788463495.548296:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463495.548299:0:15469:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e1a680 x1875339485827584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463512 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463495.548308:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463495.548311:0:15469:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:1.0:1788463495.548446:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463495.548455:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463495.548464:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463495.548468:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463495.548479:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463495.548487:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463495.548493:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463495.548496:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788463495.548499:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788463495.548516:0:8455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:1.0:1788463495.548519:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463495.548526:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961785e21600/0x841acb7f42a3976c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39773 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463495.548540:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463495.548542:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463495.548544:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463495.549143:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485827584:0@lo:38:kworker.0 00000100:00080000:3.0:1788463495.550286:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463495.550302:0:15469:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e18700 x1875339485827712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463508 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463495.550387:0:15469:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1c2a00 x1875339485828096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463495.550411:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463495.550419:0:15469:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788463495.550459:0:15469:0:(import.c:65:import_set_state_nolock()) ffff96188faf1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788463495.550555:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485828096:0@lo:400:kworker.0 00000100:00100000:2.0:1788463495.550945:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485827712:0@lo:400:kworker.0 00000100:00100000:2.0:1788463495.550980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485828352:0@lo:39:umount.0 00000400:00000100:2.0:1788463495.551045:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828352 offset 0 length 224: 4 00000001:00100000:3.0:1788463495.560687:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788463495.560702:0:8434:0:(genops.c:885:class_export_put()) final put ffff961781dae000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788463495.561140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961781dae000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788463495.561198:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961781daa800 for lustre-OST0000 00000001:00100000:0.0:1788463495.561335:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788463495.561341:0:9518:0:(genops.c:885:class_export_put()) final put ffff961787c79000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788463495.561387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff961787c79000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788463495.561432:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961787c7e800 for lustre-OST0001 00010000:00010000:3.0:1788463495.814130:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463496.835743:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788463497.539934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788463497.539945:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463497.539948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788463497.539952:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463497.540078:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463497.540100:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485828480:0@lo:400:kworker.0 00000400:00000100:0.0:1788463497.540165:0:3651:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828480 offset 0 length 224: 4 00010000:00010000:1.0:1788463497.863393:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463498.884082:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463499.651812:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463489/real 1788463489] req@ffff96188fa1aa00 x1875339485827456/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463499.651848:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188fa1aa00 x1875339485827456/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463499.651891:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961886ddc000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463499.651919:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788463499.651923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485827456:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788463499.652036:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463499.652042:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788463499.652045:0:8:0:(import.c:65:import_set_state_nolock()) ffff961886ddc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463499.652050:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788463499.652055:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788463499.652061:0:8:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961886ddc000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463499.652101:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c2a00 x1875339485828608/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463499.652115:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463499.652119:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463499.652277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485828608:0@lo:250:kworker.0 00000400:00000100:2.0:1788463499.652319:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339485828608 offset 0 length 520: 4 00000100:00100000:3.0:1788463499.652648:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463499.652665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485828736:0@lo:400:kworker.0 00000400:00000100:3.0:1788463499.652691:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828736 offset 0 length 224: 4 00010000:00010000:2.0:1788463499.907734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463500.932808:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463501.959169:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463502.979776:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463504.009768:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788463504.776088:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788463504.776104:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463504.776108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788463504.776112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463504.776303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463504.776329:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485828864:0@lo:400:kworker.0 00000400:00000100:0.0:1788463504.776409:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828864 offset 0 length 224: 4 00010000:00010000:3.0:1788463505.028032:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463505.797126:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463495/real 1788463495] req@ffff961787e19f80 x1875339485828352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463505.797172:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e19f80 x1875339485828352/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463505.797189:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188faf1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788463505.797211:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485828352:0@lo:39:umount.0 00000100:00080000:3.0:1788463505.797422:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463505.797428:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463505.797435:0:15469:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788463505.802413:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802440:0:15469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802449:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802458:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802493:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463505.802502:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802509:0:15469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802516:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463505.802524:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.802770:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463505.802779:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.802788:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463505.802801:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.802824:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463505.802832:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463505.802839:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463505.802842:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1788463505.802859:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:2.0:1788463505.802863:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.802870:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4a00/0x841acb7f42a3977a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39781 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.802905:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463505.802907:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463505.802909:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463505.804826:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463505.804839:0:15469:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788463505.804847:0:15469:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788463505.804901:0:15469:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788463505.804907:0:15469:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788463505.804915:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463505.804922:0:15469:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463505.804927:0:15469:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96188f9bb380) has no exports 00000020:00080000:3.0:1788463505.804961:0:15469:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff96188f9bb380) has no exports 00010000:00010000:2.0:1788463505.812055:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463505.812076:0:8455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.812090:0:8455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463505.812096:0:8455:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.812109:0:8455:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463505.812148:0:8455:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463505.812155:0:8455:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788463505.812158:0:8455:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788463505.812163:0:8455:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788463505.812192:0:8455:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:2.0:1788463505.812197:0:8455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.812205:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0d200/0x841acb7f42a399f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a399f7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463505.812223:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463505.812225:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463505.812227:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788463505.812537:0:15469:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787b1b240 - data ffff96188bf541b0/ffff961891f34400 00000020:01000000:3.0:1788463505.813146:0:15469:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961888ec0ba0 - data ffff96188bdaf360/ffff961781d1d000 00100000:10000000:3.0:1788463505.829540:0:15469:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788463505.847782:0:15469:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a394cc 00000020:00000080:3.0:1788463505.847799:0:15469:0:(genops.c:885:class_export_put()) final put ffff96188faf4000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788463505.847819:0:15469:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f7d1000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788463505.847824:0:15469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f7d1000 2 00000020:01000004:3.0:1788463505.847828:0:15469:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96188f7d1000 from lustre-OST0000 00000020:00000080:3.0:1788463505.847856:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463505.847869:0:15469:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788463505.847873:0:15469:0:(genops.c:885:class_export_put()) final put ffff96188faf3000/lustre-OST0000_UUID 00000020:00000080:3.0:1788463505.847877:0:15469:0:(genops.c:844:class_export_destroy()) destroying export ffff96188faf3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788463505.847898:0:15469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788463505.847963:0:15469:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788463505.847968:0:15469:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788463505.847972:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463505.847978:0:15469:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788463505.847987:0:15469:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9617868f5800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788463505.847994:0:15469:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff96188f600000) has exports, disconnecting them 00000020:00080000:3.0:1788463505.848000:0:15469:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9617868f5800), last request at 1788463228 00000020:00000080:3.0:1788463505.848017:0:15469:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a394f6 00000020:00080000:3.0:1788463505.848027:0:15469:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9617868f5800): rc 0 00000020:00000080:3.0:1788463505.848033:0:15469:0:(genops.c:885:class_export_put()) final put ffff9617868f5800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788463505.848928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188faf4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788463505.848949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9617868f5800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788463505.856013:0:15469:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788463505.856026:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463505.856031:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788463505.856041:0:15469:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463505.856462:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463505.856476:0:15469:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788463505.856484:0:15469:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788463505.856491:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463505.856496:0:15469:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788463505.856507:0:15469:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff96188d109000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463505.856516:0:15469:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff96188fbd3380) has exports, disconnecting them 00000020:00080000:0.0:1788463505.856522:0:15469:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff96188d109000), last request at 1788463228 00000020:00000080:0.0:1788463505.856527:0:15469:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3950b 00000020:00080000:0.0:1788463505.856558:0:15469:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff96188d109000): rc 0 00000020:00000080:0.0:1788463505.856566:0:15469:0:(genops.c:885:class_export_put()) final put ffff96188d109000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788463505.856786:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9617868f3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788463505.856798:0:8:0:(genops.c:885:class_export_put()) final put ffff96188f410800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788463505.856802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f410800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788463505.856810:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788463505.858200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d109000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788463505.861653:0:15469:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788463505.861665:0:15469:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788463505.861686:0:15469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788463505.861696:0:15469:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788463505.861945:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463505.861969:0:15469:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788463505.861982:0:15469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f7d1000 1 00000020:00000080:0.0:1788463505.861991:0:15469:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39494 00000020:00000080:0.0:1788463505.862002:0:15469:0:(genops.c:885:class_export_put()) final put ffff96188cedb800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788463505.862009:0:15469:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788463505.862014:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463505.862019:0:15469:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788463505.862023:0:15469:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff96188f9b99c0) has no exports 00000020:00000080:0.0:1788463505.871258:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188faf1000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788463505.871286:0:8:0:(genops.c:885:class_export_put()) final put ffff96188d10a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788463505.871290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188d10a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788463505.871308:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788463505.873096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788463505.934848:0:15469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463505.934869:0:15469:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788463505.934889:0:15469:0:(genops.c:885:class_export_put()) final put ffff96188f7d6800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788463505.934896:0:15469:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f7d6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788463505.934914:0:15469:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788463505.935072:0:15469:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188f7d6000 00000020:02000400:0.0:1788463505.935131:0:15469:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788463506.052874:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463507.075957:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463508.099798:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788463508.739706:0:3651:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463492/real 1788463492] req@ffff961787e18000 x1875339485827968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463508.787265:0:3651:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff961787e18000 x1875339485827968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463508.787289:0:3651:0:(import.c:65:import_set_state_nolock()) ffff96188f416800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788463508.787296:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788463508.807396:0:3651:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1788463508.807462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463508.807468:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463508.807471:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463508.807474:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463508.807477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788463508.807479:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788463508.807483:0:8:0:(import.c:65:import_set_state_nolock()) ffff96188f416800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463508.807492:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 290 00000100:00080000:3.0:1788463508.807502:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff96188f416800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463508.807544:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1b480 x1875339485828992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463508.807624:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485827968:0@lo:400:kworker.0 00000100:00100000:2.0:1788463508.809373:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485828992:0@lo:38:kworker.0 00000400:00000100:2.0:1788463508.809460:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339485828992 offset 0 length 520: 4 00010000:00010000:3.0:1788463509.130060:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463510.074236:0:15671:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788463510.087171:0:15671:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788463510.087257:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.087272:0:15671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.087281:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.087288:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.087304:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463510.087309:0:15671:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788463510.087337:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463510.087349:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e19500 x1875339485827840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.087373:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463510.087380:0:15671:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463510.087386:0:15671:0:(import.c:65:import_set_state_nolock()) ffff96188faf6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788463510.087391:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463510.087395:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e19500 x1875339485827840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463512 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.087403:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463510.087406:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1788463510.089005:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485827840:0@lo:38:kworker.0 00010000:00010000:2.0:1788463510.090195:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463510.090209:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463510.090223:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463510.090228:0:6512:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463510.090276:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463510.090284:0:6512:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463510.090296:0:6512:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463510.090298:0:6512:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788463510.090302:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788463510.090321:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:2.0:1788463510.090325:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463510.090332:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f4600/0x841acb7f42a39750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39757 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463510.090347:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463510.090349:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463510.090351:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463510.090934:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463510.090948:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1c3480 x1875339485828224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.090970:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188fa1bb80 x1875339485828480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463513 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091000:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1c0e00 x1875339485828736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091016:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188fa1aa00 x1875339485828864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463520 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091032:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e1b480 x1875339485828992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463518 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091043:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788463510.091051:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485828480:0@lo:400:kworker.0 00000100:00100000:3.0:1788463510.091062:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485828736:0@lo:400:kworker.0 00000100:00080000:3.0:1788463510.091083:0:15671:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788463510.091087:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3649:1875339485828864:0@lo:400:kworker.0 00000100:00080000:3.0:1788463510.091089:0:15671:0:(import.c:65:import_set_state_nolock()) ffff96188f416800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788463510.091094:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463510.091098:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1c3480 x1875339485828224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463511 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091106:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188fa1aa00 x1875339485828864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463520 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091114:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff961787e1b480 x1875339485828992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463518 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463510.091120:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788463510.093013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485828224:0@lo:400:kworker.0 00000100:00100000:3.0:1788463510.095770:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788463510.097414:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485828992:0@lo:38:kworker.0 00010000:00010000:3.0:1788463510.100763:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100782:0:15671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100790:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100821:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100844:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463510.100853:0:15671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100860:0:15671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100866:0:15671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100872:0:15671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463510.100942:0:15671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788463510.100947:0:15671:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788463510.100980:0:15671:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788463510.100984:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788463510.100989:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463510.100995:0:15671:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463510.100999:0:15671:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff96188f604d40) has no exports 00000020:00080000:3.0:1788463510.101021:0:15671:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff96188f604d40) has no exports 00010000:00010000:0.0:1788463510.106970:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463510.106992:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107023:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463510.107028:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107038:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463510.107045:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463510.107050:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463510.107053:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788463510.107056:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788463510.107075:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:0.0:1788463510.107079:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107086:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff96188f6f5000/0x841acb7f42a3975e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39765 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107100:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463510.107104:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107110:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:0.0:1788463510.107113:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.107121:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788463510.108430:0:15671:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787b1b840 - data ffff96188bf49360/ffff961891f34800 00000020:01000000:3.0:1788463510.108620:0:15671:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff961787363de0 - data ffff96188be74798/ffff961787cdf400 10000000:00010000:0.0:1788463510.108815:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463510.108823:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788463510.108827:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788463510.108830:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788463510.108844:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:0.0:1788463510.108849:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.108857:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961882812400/0x841acb7f42a399e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a399e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.108878:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463510.108881:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463510.108885:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463510.111543:0:8455:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788463510.145087:0:15671:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788463510.156981:0:15671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a395f2 00000020:00000080:0.0:1788463510.156999:0:15671:0:(genops.c:885:class_export_put()) final put ffff961787251000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788463510.157032:0:15671:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188f993000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788463510.157037:0:15671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f993000 2 00000020:01000004:0.0:1788463510.157041:0:15671:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff96188f993000 from lustre-OST0001 00000020:00000080:0.0:1788463510.157076:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463510.157089:0:15671:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788463510.157093:0:15671:0:(genops.c:885:class_export_put()) final put ffff961787254000/lustre-OST0001_UUID 00000020:00000080:0.0:1788463510.157096:0:15671:0:(genops.c:844:class_export_destroy()) destroying export ffff961787254000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788463510.157103:0:15671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1788463510.157348:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787251000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788463510.157814:0:15671:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 760a69d7-d23f-4a71-8b75-cca21d577f9e->MGS 00010000:00010000:0.0:1788463510.158442:0:15671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961880031800/0x841acb7f42a3934b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463510.158554:0:15671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961880031800/0x841acb7f42a3934b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463510.158562:0:15671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788463510.158566:0:15671:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788463510.158571:0:15671:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788463510.158750:0:15671:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:0.0:1788463510.158755:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961880031800/0x841acb7f42a3934b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a39352 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463510.158778:0:15671:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463510.158785:0:15671:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463510.158790:0:15671:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788463510.158792:0:15671:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788463510.158794:0:15671:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788463510.158822:0:15671:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff961886ddc000 00010000:00010000:0.0:1788463510.158826:0:15671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a397c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x841acb7f42a397c7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463510.158846:0:15671:0:(import.c:65:import_set_state_nolock()) ffff961886ddc000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788463510.158851:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788463510.158854:0:15671:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788463510.158856:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788463510.158862:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788463510.159044:0:15671:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff96188d1c2a00 x1875339485828608/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788463514 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788463510.159074:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788463510.159077:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1788463510.159233:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:760a69d7-d23f-4a71-8b75-cca21d577f9e:3647:1875339485828608:0@lo:250:kworker.0 10000000:01000000:0.0:1788463510.159373:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788463510.159383:0:15671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39248 00000020:00000080:0.0:1788463510.159393:0:15671:0:(genops.c:885:class_export_put()) final put ffff961886ddd000/760a69d7-d23f-4a71-8b75-cca21d577f9e 00000020:01000000:0.0:1788463510.159559:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.153@tcp (flags='') 00000020:00000080:0.0:1788463510.159567:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463510.159613:0:15671:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788463510.159620:0:15671:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff961884ff19c0) has no exports 10000000:01000000:1.0:1788463510.159831:0:6520:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788463510.161066:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961886ddd000/760a69d7-d23f-4a71-8b75-cca21d577f9e for MGC192.168.204.153@tcp 10000000:01000000:0.0:1788463510.161170:0:15671:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.153@tcp: client import never connected 00000100:00080000:0.0:1788463510.161177:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788463510.161182:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788463510.161186:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788463510.161190:0:15671:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788463510.161320:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff961886ddc000 for MGC192.168.204.153@tcp 00000020:00000080:0.0:1788463510.161352:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463510.161365:0:15671:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.153@tcp (uuid 760a69d7-d23f-4a71-8b75-cca21d577f9e) 00000020:00000080:0.0:1788463510.161371:0:15671:0:(genops.c:885:class_export_put()) final put ffff961886ddd800/760a69d7-d23f-4a71-8b75-cca21d577f9e 00000020:00000080:0.0:1788463510.161375:0:15671:0:(genops.c:844:class_export_destroy()) destroying export ffff961886ddd800/760a69d7-d23f-4a71-8b75-cca21d577f9e for MGC192.168.204.153@tcp 00000020:01000000:0.0:1788463510.161382:0:15671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.153@tcp (760a69d7-d23f-4a71-8b75-cca21d577f9e) 00000020:01000000:0.0:1788463510.162208:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788463510.162222:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463510.162229:0:15671:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788463510.162239:0:15671:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff961787a59000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463510.162248:0:15671:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff96178790cd40) has exports, disconnecting them 00000020:00080000:0.0:1788463510.162253:0:15671:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff961787a59000), last request at 1788463250 00000020:00000080:0.0:1788463510.162340:0:15671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3961c 00000020:00080000:0.0:1788463510.162366:0:15671:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961787a59000): rc 0 00000020:00000080:0.0:1788463510.162373:0:15671:0:(genops.c:885:class_export_put()) final put ffff961787a59000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788463510.162702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787a59000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788463510.165636:0:15671:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788463510.165646:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788463510.165651:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788463510.165659:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463510.166043:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463510.166053:0:15671:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788463510.166061:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788463510.166067:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463510.166071:0:15671:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463510.166078:0:15671:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff961787a5f000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463510.166085:0:15671:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff96188fbd0000) has exports, disconnecting them 00000020:00080000:1.0:1788463510.166090:0:15671:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff961787a5f000), last request at 1788463250 00000020:00000080:1.0:1788463510.166094:0:15671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a39631 00000020:00080000:1.0:1788463510.166113:0:15671:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff961787a5f000): rc 0 00000020:00000080:1.0:1788463510.166119:0:15671:0:(genops.c:885:class_export_put()) final put ffff961787a5f000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788463510.167550:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188faf6800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788463510.167780:0:8:0:(genops.c:885:class_export_put()) final put ffff96188f415000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788463510.167789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f415000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788463510.167810:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788463510.168446:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff961787a5f000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788463510.173684:0:15671:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788463510.173697:0:15671:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788463510.173703:0:15671:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788463510.173720:0:15671:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788463510.173849:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff96188f416800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788463510.176611:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788463510.177093:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788463510.178000:0:8455:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788463510.178165:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9618b43fa800:6507] 1 exiting: rc = 0 00000100:00100000:2.0:1788463510.178279:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff961888edc000:6506] 0 exiting: rc = 1 00000100:00100000:3.0:1788463510.178350:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.179160:0:6552:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff96188cf19e00:6552] 3 exiting: rc = 0 00000100:00100000:1.0:1788463510.183604:0:9527:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff96178727ac00:9527] 4 exiting: rc = 0 00000100:00100000:1.0:1788463510.183738:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff961894591400:6508] 0 exiting: rc = 1 00000100:00100000:0.0:1788463510.184423:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9618b2e4ea00:6509] 1 exiting: rc = 0 00000100:00100000:0.0:1788463510.185141:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff961888b8d800:6510] 2 exiting: rc = 0 00000100:00100000:3.0:1788463510.185330:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185341:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185349:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185354:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185360:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185367:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185373:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185379:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185385:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185391:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185396:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185401:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185407:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185413:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185420:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185426:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185432:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185459:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185468:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185476:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185485:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185495:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185506:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185524:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185551:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185559:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185565:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185571:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185609:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185615:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185621:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185627:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185633:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185639:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185644:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185650:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185656:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185662:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185669:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185675:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185682:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185688:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185695:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185701:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185707:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185713:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185718:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185724:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185730:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185736:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185742:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185748:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185763:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185769:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185775:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185781:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185792:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185816:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185825:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185832:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185837:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185843:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185853:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.185873:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788463510.193379:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463510.193406:0:15671:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788463510.193419:0:15671:0:(genops.c:885:class_export_put()) final put ffff9618c1ad4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788463510.193425:0:15671:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ad4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788463510.193432:0:15671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788463510.193498:0:15671:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188f993000 1 00000020:00000080:3.0:1788463510.193505:0:15671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a395c1 00000020:00000080:3.0:1788463510.193517:0:15671:0:(genops.c:885:class_export_put()) final put ffff9618c1ad2800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788463510.193537:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788463510.193551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9618c1ad2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788463510.193564:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463510.193570:0:15671:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463510.193610:0:15671:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff96188f9bcd40) has no exports 00000020:00000080:2.0:1788463510.261946:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463510.261961:0:15671:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788463510.261968:0:15671:0:(genops.c:885:class_export_put()) final put ffff96188f991000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788463510.261972:0:15671:0:(genops.c:844:class_export_destroy()) destroying export ffff96188f991000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788463510.261983:0:15671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788463510.262384:0:15671:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff96188f994000 00000020:01000000:2.0:1788463510.262414:0:15671:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788463510.262419:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463510.262423:0:15671:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788463510.262430:0:15671:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff96188fbd19c0) has no exports 00000020:00000080:2.0:1788463510.262451:0:15671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463510.262461:0:15671:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788463510.262464:0:15671:0:(genops.c:885:class_export_put()) final put ffff96188cedd800/OSS_uuid 00000020:00000080:2.0:1788463510.262467:0:15671:0:(genops.c:844:class_export_destroy()) destroying export ffff96188cedd800/OSS_uuid for OSS 00000020:01000000:2.0:1788463510.262470:0:15671:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788463510.262841:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96188faecc00:8439] 0 exiting: rc = 1 00000100:00100000:2.0:1788463510.262942:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96188cffec00:8441] 2 exiting: rc = 0 00000100:00080000:2.0:1788463510.262983:0:6519:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788463510.263156:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff96188faec400:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1788463510.263713:0:9857:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9617868cce00:9857] 3 exiting: rc = 0 00000100:00100000:2.0:1788463510.263831:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263841:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263850:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263863:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263870:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263875:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263880:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263886:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263890:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263895:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263900:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263905:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263910:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263915:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263920:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263925:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263931:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263935:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263940:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263945:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263951:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263957:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263974:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263979:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263984:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263988:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263993:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.263997:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264002:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264007:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264012:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264017:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264022:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264027:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264032:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264038:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264043:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264049:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264055:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264060:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264065:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264071:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264076:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264081:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264086:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264091:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264096:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264101:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264107:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264112:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264118:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264123:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264129:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264135:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264140:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264145:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264150:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264163:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264168:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264172:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264177:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264183:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264187:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.264193:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463510.265134:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff961889e6d400:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1788463510.265257:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff96188f6d7600:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1788463510.265648:0:13831:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff961787da3600:13831] 2 exiting: rc = 0 00000100:00100000:2.0:1788463510.265737:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265746:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265755:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265760:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265766:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265771:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265775:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265780:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265784:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265789:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265793:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265811:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265816:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265821:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265826:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265831:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265836:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265842:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265852:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265858:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265863:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265868:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265874:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265879:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265884:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265889:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265894:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265899:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265915:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265919:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265924:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265929:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265939:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265944:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265949:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265954:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265959:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265964:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265973:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265978:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265983:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265988:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265993:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.265997:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266002:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266007:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266013:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266017:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266022:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266027:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266032:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266037:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266042:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266047:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266052:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266057:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266062:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266067:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266072:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266077:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266082:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266087:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266092:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.266104:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.267126:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff96188f6e4400:8446] 2 exiting: rc = 0 00000100:00100000:3.0:1788463510.267339:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff96188d0b6e00:8445] 1 exiting: rc = 0 00000100:00100000:1.0:1788463510.268025:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff96188fe58e00:8444] 0 exiting: rc = 1 00000100:00100000:3.0:1788463510.268139:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268147:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268152:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268158:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268164:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268185:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268201:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268206:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268211:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268216:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268221:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268227:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268233:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268238:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268243:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268248:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268253:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268258:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268263:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268269:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268274:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268279:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268284:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268289:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268295:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268301:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268306:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268311:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268316:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268337:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268345:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268351:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268357:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268362:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268369:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268374:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268379:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268385:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268390:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268395:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268400:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268417:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268423:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268428:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268433:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268438:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268444:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268449:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268454:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268460:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268466:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268471:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268476:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268490:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268518:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268525:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268537:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268547:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268552:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268557:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268562:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268568:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268601:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.268609:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.274418:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff961884e65200:8448] 1 exiting: rc = 0 00000100:00100000:0.0:1788463510.277473:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff96188d31f400:8447] 0 exiting: rc = 1 00000100:00100000:3.0:1788463510.277746:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277757:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277765:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277773:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277781:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277811:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277819:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277824:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277830:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277834:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277850:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277855:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277873:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277879:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277903:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277909:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277914:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277919:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277926:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277931:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277937:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277943:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277948:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277953:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277958:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277964:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277970:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277975:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277980:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277985:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277990:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.277996:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278001:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278006:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278012:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278017:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278022:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278028:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278034:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278039:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278045:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278050:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278055:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278060:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278065:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278070:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278075:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278089:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278140:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278146:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278152:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278158:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278163:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278169:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278175:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278180:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278186:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278192:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278198:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278203:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278208:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278214:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278219:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463510.278225:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463510.279385:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96188d0f3000:8450] 1 exiting: rc = 0 00000100:00100000:0.0:1788463510.279533:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff96188f70bc00:8449] 0 exiting: rc = 1 00000100:00100000:2.0:1788463510.283307:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283319:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283325:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283331:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283338:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283344:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283419:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283427:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283434:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283440:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283447:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283453:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283474:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283482:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283487:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283493:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283499:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283504:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283510:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283515:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283521:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283526:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283532:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283536:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283554:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283562:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283567:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283572:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283606:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283613:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283622:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283628:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283651:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283658:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283665:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283673:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283697:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283705:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283711:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283716:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283722:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283727:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.283733:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284069:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284079:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284085:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284091:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284096:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284115:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284122:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284127:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284132:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284138:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284144:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284224:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284231:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284236:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284241:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284246:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284252:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284271:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284278:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284284:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463510.284290:0:15671:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788463510.295179:0:15671:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788463535.758932:0:16435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788463546.896754:0:17035:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788463546.896761:0:17035:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788463546.896762:0:17035:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788463546.896900:0:17035:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96189154b000 00000020:01000004:1.0:1788463546.896922:0:17035:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788463546.896930:0:17035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788463546.896944:0:17035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9617879099c0) 00000020:00000080:1.0:1788463546.896958:0:17035:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788463546.958200:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788463546.961163:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788463546.965567:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.967217:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788463546.968043:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.968330:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788463546.968598:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788463546.968794:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788463546.969225:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.969565:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.970053:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.970440:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788463546.970771:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.971176:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788463546.971478:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788463546.972490:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.973196:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.973550:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.974034:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.974360:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.974639:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.975096:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.975351:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.975609:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.975856:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.976180:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.976420:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.976626:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.976987:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.977352:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.977618:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.978397:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.979121:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.980162:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.981095:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.981453:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.981784:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.982169:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788463546.982351:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.982571:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.982854:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.983655:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.985296:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.986918:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.987299:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788463546.987529:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788463546.988278:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788463546.989102:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788463546.989543:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788463546.989855:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788463546.990506:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788463546.991023:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788463546.991276:0:17035:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:1.0:1788463546.992769:0:17035:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788463546.993006:0:17035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788463546.993014:0:17035:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788463546.993028:0:17035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a805 00000020:01000004:1.0:1788463546.993037:0:17035:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788463546.993042:0:17035:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788463546.993048:0:17035:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96189154b000 from MGS 00000020:01000004:1.0:1788463546.993052:0:17035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788463546.993063:0:17035:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff96178790b380) 00000020:00000080:1.0:1788463546.993073:0:17035:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788463546.993153:0:17035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96189154b000 from MGS, refs=2 00080000:01000000:1.0:1788463546.993159:0:17035:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788463546.993164:0:17035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a813 00000100:00100000:1.0:1788463546.993279:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788463546.993446:0:17035:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788463546.993452:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788463546.994674:0:17035:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788463546.994683:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788463546.995789:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463546.996120:0:17035:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788463546.996133:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788463546.997094:0:17035:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788463546.997102:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788463546.997534:0:17035:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788463546.997540:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788463546.999181:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463546.999187:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463546.999189:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463546.999687:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463546.999690:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463546.999692:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463547.000451:0:17035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788463547.002397:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788463547.007494:0:17035:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788463547.014595:0:17048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788463547.014688:0:17035:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788463547.014759:0:17035:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463547.015941:0:17035:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788463547.016286:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463547.016484:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788463547.016490:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788463547.017363:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788463547.017383:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788463547.017843:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788463547.017849:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788463547.019043:0:17052:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788463547.019158:0:17035:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788463547.019179:0:17035:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.153@tcp' 00000020:01000004:0.0:1788463547.019181:0:17035:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788463547.019214:0:17035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.153@tcp (typ=mgc) 00000020:00000080:0.0:1788463547.019228:0:17035:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.153@tcp (ffff96188fbd3380) 00000020:00000080:0.0:1788463547.019246:0:17035:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788463547.019327:0:17035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961786884800@MGC192.168.204.153@tcp: add connection 192.168.204.153@tcp at head 00010000:00010000:0.0:1788463547.020307:0:17035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.153@tcp-0 is initialized 00000040:01000000:0.0:1788463547.020316:0:17035:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788463547.023229:0:17054:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788463547.023317:0:17035:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.153@tcp (uuid 61537c78-f571-4169-84d6-9d8a2058e62c) 00000020:00000080:2.0:1788463547.023345:0:17035:0:(genops.c:1385:class_connect()) connect: client 61537c78-f571-4169-84d6-9d8a2058e62c, cookie 0x841acb7f42a3a821 00000100:00080000:2.0:1788463547.023357:0:17035:0:(import.c:545:import_select_connection()) MGC192.168.204.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463547.023364:0:17035:0:(import.c:665:import_select_connection()) MGC192.168.204.153@tcp: import ffff961786884800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463547.023410:0:17035:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa1a300 x1875339485829120/t0(0) o250->MGC192.168.204.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463547.023437:0:17035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 61537c78-f571-4169-84d6-9d8a2058e62c->MGS 00000020:01000004:2.0:1788463547.023457:0:17035:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788463547.023462:0:17035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788463547.023475:0:17035:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff96188f9bcd40) 00000020:00000080:2.0:1788463547.023488:0:17035:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788463547.024846:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485829120:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788463547.024945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463547.025028:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829120 00000100:00100000:1.0:1788463547.025037:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829120 00000100:00100000:1.0:1788463547.025069:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463547.025077:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3647:x1875339485829120:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788463547.025119:0:17049:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 61537c78-f571-4169-84d6-9d8a2058e62c@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:1.0:1788463547.025146:0:17049:0:(genops.c:1385:class_connect()) connect: client 61537c78-f571-4169-84d6-9d8a2058e62c, cookie 0x841acb7f42a3a82f 00000100:00080000:1.0:1788463547.025291:0:17049:0:(import.c:65:import_set_state_nolock()) ffff96188d0ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463547.025342:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+5:3647:x1875339485829120:12345-0@lo:250:mount.lustre.0 Request processed in 263us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463547.025350:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463547.025417:0:3647:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788463547.025428:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.153@tcp: connect to target with instance 0 00000100:00080000:1.0:1788463547.025438:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788463547.025443:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788463547.025457:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786884800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788463547.025460:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788463547.025469:0:3647:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788463547.025474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:61537c78-f571-4169-84d6-9d8a2058e62c:3647:1875339485829120:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788463547.044049:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463547.044288:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463547.044295:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788463547.049041:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463547.049057:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788463547.049818:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463547.049827:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788463547.051017:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463547.051213:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788463547.051218:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788463547.058330:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788463547.058350:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788463547.103403:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463547.103650:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788463547.103657:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788463547.105466:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788463547.105482:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788463547.106773:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463547.106992:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463547.106998:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788463547.108524:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463547.108535:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788463547.115566:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463547.115838:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463547.115845:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788463547.116859:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788463547.116868:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788463547.117834:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463547.118008:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788463547.118014:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788463547.118894:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788463547.118903:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788463547.154890:0:17035:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463547.155132:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463547.155139:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788463547.160859:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788463547.160878:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788463547.162023:0:17035:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463547.162035:0:17035:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788463547.162871:0:17035:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788463547.162906:0:17035:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788463547.162913:0:17035:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788463547.163032:0:17035:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788463547.163074:0:17035:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788463547.163093:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788463547.163095:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788463547.163097:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463547.163100:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463547.163101:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463547.163103:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463547.163105:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463547.163106:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788463547.163108:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463547.163109:0:17035:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463547.163112:0:17035:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788463547.163115:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463547.163116:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788463547.163117:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463547.163118:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463547.163119:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463547.163121:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463547.163122:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463547.163123:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788463547.163124:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463547.163126:0:17035:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463547.163172:0:17035:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788463547.163195:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788463547.163292:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.163352:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188f9f6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463547.163664:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829248 00000100:00100000:0.0:1788463547.163672:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829248 00000100:00100000:0.0:1788463547.163713:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463547.163724:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+5:17035:x1875339485829248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788463547.163769:0:17051:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788463547.163773:0:17051:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788463547.163775:0:17051:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788463547.164120:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788463547.164784:0:17051:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788463547.171446:0:17073:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788463547.171455:0:17073:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788463547.171458:0:17073:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788463547.171460:0:17073:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788463547.174566:0:17073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788463547.175333:0:17051:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463547.175345:0:17051:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788463547.183271:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+5:17035:x1875339485829248:12345-0@lo:253:mount.lustre.0 Request processed in 19536us (19966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.183292:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463547.183433:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788463547.183449:0:17035:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788463547.183453:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788463547.183456:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788463547.183457:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463547.183459:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463547.183460:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463547.183462:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463547.183464:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788463547.183465:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788463547.183467:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463547.183469:0:17035:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788463547.183488:0:17035:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96189154b000 from lustre-MDT0000 10000000:01000000:0.0:1788463547.183518:0:17035:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788463547.183536:0:17035:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788463547.183542:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96188fbd3380 10000000:01000000:0.0:1788463547.183547:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463547.183554:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff96188fbd3380 from 1 10000000:01000000:0.0:1788463547.183557:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788463547.183760:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.183772:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.183782:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.183802:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463547.183843:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.183933:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463547.184547:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829376 00000100:00100000:1.0:1788463547.184554:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829376 00000100:00100000:1.0:1788463547.184916:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463547.184927:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+5:17035:x1875339485829376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463547.184942:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463547.184960:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0ca00/0x841acb7f42a3a83d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a836 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463547.184984:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0ca00/0x841acb7f42a3a83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a836 expref: 6 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463547.184996:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0ca00/0x841acb7f42a3a83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a836 expref: 6 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463547.185005:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ca00, rc 0) 00000100:00100000:1.0:1788463547.185062:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+6:17035:x1875339485829376:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463547.185068:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463547.185162:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463547.185181:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.185190:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.185248:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463547.185276:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.185348:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.185475:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829504 00000100:00100000:3.0:1788463547.185491:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829504 00000100:00100000:3.0:1788463547.185516:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463547.185523:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+6:17035:x1875339485829504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463547.185685:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+6:17035:x1875339485829504:12345-0@lo:501:mount.lustre.0 Request processed in 162us (409us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463547.185692:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463547.185973:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829504:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788463547.186010:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788463547.186067:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186076:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463547.186095:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96189154b000 10000000:01000000:0.0:1788463547.186100:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788463547.186105:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96189154b000 10000000:01000000:0.0:1788463547.186107:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788463547.186110:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96189154b000 from 1 10000000:01000000:0.0:1788463547.186113:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788463547.186135:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186143:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186151:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.186165:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463547.186190:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.186218:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.186267:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829632 00000100:00100000:3.0:1788463547.186271:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829632 00000100:00100000:3.0:1788463547.186304:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463547.186311:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+6:17035:x1875339485829632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463547.186319:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463547.186332:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde400/0x841acb7f42a3a84b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a844 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.186347:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde400/0x841acb7f42a3a84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a844 expref: 7 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.186354:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde400/0x841acb7f42a3a84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a844 expref: 7 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.186361:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde400, rc 0) 00000100:00100000:3.0:1788463547.186501:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+7:17035:x1875339485829632:12345-0@lo:101:mount.lustre.0 Request processed in 190us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.186507:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463547.186570:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463547.186611:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186619:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463547.186637:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788463547.186896:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186905:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc0600/0x841acb7f42a3a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a84b expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463547.186913:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788463547.186916:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463547.186921:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96189154b000 10000000:01000000:0.0:1788463547.186924:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788463547.186927:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788463547.186930:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463547.186945:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186952:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.186960:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.186974:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463547.187001:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.187028:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.187087:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829760 00000100:00100000:2.0:1788463547.187093:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829760 00000100:00100000:2.0:1788463547.187130:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463547.187138:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+7:17035:x1875339485829760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463547.187145:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463547.187156:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26a00/0x841acb7f42a3a859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a852 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.187171:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26a00/0x841acb7f42a3a859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a852 expref: 8 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.187179:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26a00/0x841acb7f42a3a859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a852 expref: 8 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.187186:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26a00, rc 0) 00000100:00100000:2.0:1788463547.187220:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+8:17035:x1875339485829760:12345-0@lo:101:mount.lustre.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.187237:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463547.187327:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463547.187342:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.187357:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.187486:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463547.187511:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.187530:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.187604:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485829888 00000100:00100000:3.0:1788463547.187608:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485829888 00000100:00100000:3.0:1788463547.187634:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463547.187641:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+8:17035:x1875339485829888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463547.187781:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+9:17035:x1875339485829888:12345-0@lo:501:mount.lustre.0 Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.187789:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463547.187937:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485829888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463547.187965:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463547.188004:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.188031:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b224e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.188076:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830016 00000100:00100000:3.0:1788463547.188093:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830016 00000100:00100000:3.0:1788463547.188129:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463547.188136:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+9:17035:x1875339485830016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463547.188960:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+9:17035:x1875339485830016:12345-0@lo:503:mount.lustre.0 Request processed in 821us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.188969:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463547.189122:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463547.189556:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17074:1875339485830144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.189663:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.189742:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff96189163c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.189775:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830144 00000100:00100000:3.0:1788463547.189781:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830144 00000100:00100000:3.0:1788463547.189853:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463547.189864:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+9:17074:x1875339485830144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463547.190495:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+9:17074:x1875339485830144:12345-0@lo:502:llog_process_th.0 Request processed in 632us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.190502:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463547.190657:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17074:1875339485830144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463547.190688:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463547.190699:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463547.190702:0:17074:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788463547.190708:0:17074:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788463547.190711:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463547.190726:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff96188f9b99c0) 00000020:00000080:2.0:1788463547.190741:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788463547.190747:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788463547.190832:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788463547.190839:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a867 00000020:00000080:2.0:1788463547.191048:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788463547.191053:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463547.191057:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463547.191058:0:17074:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788463547.191061:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463547.191064:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463547.191066:0:17074:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788463547.191069:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463547.191075:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff96188f9bb380) 00000020:00000080:2.0:1788463547.191100:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788463547.191105:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788463547.191107:0:17074:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788463547.191110:0:17074:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788463547.191115:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463547.191173:0:17074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96189154b000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788463547.191186:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96188f9b8000) 00000020:00000080:2.0:1788463547.191195:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788463547.191252:0:17074:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788463547.191263:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3a87c 00000020:00000080:2.0:1788463547.191355:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788463547.191361:0:17074:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788463547.191366:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x841acb7f42a3a883 00080000:01000000:2.0:1788463547.191516:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788463547.191521:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a88a 00010000:00010000:3.0:1788463547.253787:0:17074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788463547.254351:0:17074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788463547.254708:0:17074:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788463547.255250:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff961787c98000) 00000020:00000080:3.0:1788463547.255270:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788463547.255339:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788463547.255347:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a898 00000020:00000080:0.0:1788463547.256920:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788463547.263843:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x841acb7f42a3a89f 00000020:00000080:0.0:1788463547.264753:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788463547.264766:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463547.264773:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463547.264775:0:17074:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788463547.264778:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788463547.264781:0:17074:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788463547.264783:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463547.264785:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788463547.264786:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788463547.264788:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463547.264790:0:17074:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788463547.264793:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463547.264798:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463547.264799:0:17074:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788463547.264810:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788463547.264858:0:17074:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788463547.264878:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463547.264882:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463547.264883:0:17074:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788463547.264886:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463547.264889:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463547.264890:0:17074:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788463547.264893:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788463547.264899:0:17074:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:0.0:1788463547.264929:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463547.264945:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff96188fbd4d40) 00000020:00000080:0.0:1788463547.264959:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788463547.264965:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788463547.265025:0:17074:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788463547.265032:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788463547.265038:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a8ad 00010000:00080000:0.0:1788463547.265090:0:17074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961786882800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:0.0:1788463547.266713:0:17074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788463547.272488:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463547.272505:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788463547.272566:0:17074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788463547.272697:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3a8b4 00000100:00080000:1.0:1788463547.272710:0:17074:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463547.272718:0:17074:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff961786882800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463547.272831:0:17074:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c2a00 x1875339485830272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463547.272861:0:17074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788463547.272971:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.272975:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.272977:0:17074:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788463547.272980:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788463547.272984:0:17074:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788463547.272986:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463547.272987:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463547.272989:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788463547.272991:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.272993:0:17074:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788463547.272995:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463547.273000:0:17074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788463547.273004:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.273006:0:17074:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788463547.273008:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463547.273013:0:17074:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:1.0:1788463547.273043:0:17074:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788463547.273046:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463547.273062:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff961787908000) 00000020:00000080:1.0:1788463547.273075:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788463547.273096:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463547.273169:0:17074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788463547.273175:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788463547.273180:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a8c2 00010000:00080000:1.0:1788463547.273215:0:17074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188ced9800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463547.273442:0:17074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788463547.274094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463547.274174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.274216:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830272 00000100:00100000:2.0:1788463547.274223:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830272 00000100:00100000:2.0:1788463547.274260:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463547.274269:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485830272:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788463547.274286:0:17061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788463547.275032:0:17074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788463547.277723:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788463547.280548:0:17074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463547.281382:0:17074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788463547.290221:0:17074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788463547.295729:0:17080:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788463547.295737:0:17080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788463547.299357:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485830272:12345-0@lo:38:llog_process_th.0 Request processed in 25080us (25173us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788463547.299471:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463547.299478:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463547.299482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463547.299597:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1788463547.300118:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463547.300132:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788463547.300187:0:17074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788463547.300208:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3a8c9 00000100:00080000:1.0:1788463547.300217:0:17074:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463547.300222:0:17074:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced9800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463547.300255:0:17074:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c2d80 x1875339485830400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463547.300309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830400:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788463547.300362:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485830400 offset 0 length 520: 4 00000100:00080000:1.0:1788463547.300477:0:17074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788463547.300542:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.300547:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.300549:0:17074:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788463547.300552:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788463547.300555:0:17074:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788463547.300556:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463547.300558:0:17074:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463547.300560:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788463547.300563:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.300565:0:17074:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788463547.300567:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463547.300603:0:17074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788463547.300607:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.300609:0:17074:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788463547.300613:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463547.300617:0:17074:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:1.0:1788463547.300636:0:17074:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788463547.300646:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463547.300659:0:17074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96178790cd40) 00000020:00000080:1.0:1788463547.300671:0:17074:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788463547.300677:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463547.300735:0:17074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788463547.300741:0:17074:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788463547.300747:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x841acb7f42a3a8d7 00010000:00080000:1.0:1788463547.300773:0:17074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961787d22000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463547.300977:0:17074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788463547.301056:0:17074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788463547.301074:0:17074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788463547.303090:0:17074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463547.303312:0:17074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788463547.303490:0:17074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788463547.303966:0:17082:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788463547.303971:0:17082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788463547.304835:0:17074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463547.304848:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788463547.304886:0:17074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788463547.304907:0:17074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3a8de 00000100:00080000:1.0:1788463547.304918:0:17074:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463547.304924:0:17074:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463547.304959:0:17074:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c3100 x1875339485830528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463547.304983:0:17074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788463547.305050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830528:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788463547.305120:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485830528 offset 0 length 520: 4 00000020:01000000:1.0:1788463547.305228:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.305234:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.305236:0:17074:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788463547.305239:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.305243:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.305244:0:17074:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788463547.305247:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788463547.305249:0:17074:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788463547.305260:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.305263:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.305264:0:17074:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788463547.305266:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.305270:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.305271:0:17074:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788463547.305274:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788463547.305304:0:17074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17074:1875339485830656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463547.305354:0:17074:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463547.305381:0:17074:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882928600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.305425:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830656 00000100:00100000:3.0:1788463547.305431:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830656 00000100:00100000:3.0:1788463547.305474:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463547.305483:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+9:17074:x1875339485830656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463547.305618:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+9:17074:x1875339485830656:12345-0@lo:502:llog_process_th.0 Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.305627:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463547.305782:0:17074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17074:1875339485830656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463547.305807:0:17074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.305811:0:17074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.305812:0:17074:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463547.305815:0:17074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788463547.305963:0:17035:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788463547.305989:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788463547.306010:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306021:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc0c00/0x841acb7f42a3a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a859 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463547.306029:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96189154b000 from 1 10000000:01000000:3.0:1788463547.306032:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463547.306060:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306068:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306100:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463547.306114:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463547.306144:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.306171:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.306188:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830784 00000100:00100000:3.0:1788463547.306192:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830784 00000100:00100000:3.0:1788463547.306214:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463547.306221:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+9:17035:x1875339485830784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463547.306229:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463547.306242:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a8e5 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306273:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 10 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306284:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 10 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306292:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:3.0:1788463547.306321:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+10:17035:x1875339485830784:12345-0@lo:101:mount.lustre.0 Request processed in 100us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.306327:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463547.306363:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463547.306388:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.306402:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463547.306945:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830912:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788463547.306984:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.306998:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463547.307161:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485830912 00000100:00100000:1.0:1788463547.307167:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485830912 00000100:00100000:1.0:1788463547.307204:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463547.307212:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+10:17035:x1875339485830912:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788463547.307226:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788463547.307233:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788463547.307297:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+10:17035:x1875339485830912:12345-0@lo:256:mount.lustre.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463547.307305:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463547.307373:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485830912:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788463547.307923:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788463547.307942:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.307952:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463547.307962:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96189154b000 from 1 10000000:01000000:3.0:1788463547.307965:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463547.307997:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308005:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308014:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463547.308030:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463547.308069:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.308132:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.308155:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831040 00000100:00100000:3.0:1788463547.308160:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831040 00000100:00100000:3.0:1788463547.308189:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463547.308197:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+10:17035:x1875339485831040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463547.308205:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463547.308218:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a8f3 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308240:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 11 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308251:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 11 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308260:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde200, rc 0) 00000100:00100000:3.0:1788463547.308291:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831040:12345-0@lo:101:mount.lustre.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.308296:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463547.308332:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463547.308344:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.308352:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463547.308405:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463547.308426:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.308447:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.308459:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831168 00000100:00100000:3.0:1788463547.308463:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831168 00000100:00100000:3.0:1788463547.308483:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463547.308490:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463547.308638:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831168:12345-0@lo:501:mount.lustre.0 Request processed in 148us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.308646:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463547.308677:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463547.308702:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463547.308738:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.308750:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.308761:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831296 00000100:00100000:3.0:1788463547.308764:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831296 00000100:00100000:3.0:1788463547.308784:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463547.308790:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831296:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463547.308862:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831296:12345-0@lo:503:mount.lustre.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.308869:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463547.308910:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463547.310781:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17084:1875339485831424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463547.310851:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.310933:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463547.310969:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831424 00000100:00100000:0.0:1788463547.310977:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831424 00000100:00100000:0.0:1788463547.311054:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463547.311064:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17084:x1875339485831424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463547.311557:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17084:x1875339485831424:12345-0@lo:502:llog_process_th.0 Request processed in 493us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463547.311565:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463547.312512:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17084:1875339485831424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463547.312556:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.312568:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312570:0:17084:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788463547.312602:0:17084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96189154b000 00000020:00000080:1.0:1788463547.312613:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463547.312623:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.312626:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312627:0:17084:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788463547.312630:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.312633:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312634:0:17084:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788463547.312638:0:17084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96189154b000 00000020:00000080:1.0:1788463547.312640:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463547.312716:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.312720:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312721:0:17084:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788463547.312723:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.312726:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312727:0:17084:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463547.312731:0:17084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96189154b000 00000020:00000080:1.0:1788463547.312733:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463547.312750:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463547.312753:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312754:0:17084:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463547.312756:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463547.312758:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463547.312759:0:17084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788463547.312761:0:17084:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96189154b000 00000020:00000080:1.0:1788463547.312763:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788463547.312812:0:17084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17084:1875339485831552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463547.312885:0:17084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463547.312927:0:17084:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882928480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.316561:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831552 00000100:00100000:2.0:1788463547.316618:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831552 00000100:00100000:2.0:1788463547.316674:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463547.316683:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+11:17084:x1875339485831552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.316877:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+11:17084:x1875339485831552:12345-0@lo:502:llog_process_th.0 Request processed in 194us (3992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.316886:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463547.316972:0:17084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17084:1875339485831552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463547.317017:0:17084:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463547.317026:0:17084:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463547.317029:0:17084:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788463547.317035:0:17084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788463547.321117:0:17035:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788463547.321158:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463547.321183:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321195:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463547.321263:0:17035:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463547.321266:0:17035:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96189154b000 10000000:01000000:2.0:1788463547.321269:0:17035:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96189154b000 10000000:01000000:2.0:1788463547.321273:0:17035:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463547.321280:0:17035:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96189154b000 from 1 10000000:01000000:2.0:1788463547.321282:0:17035:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463547.321323:0:17035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321331:0:17035:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321342:0:17035:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463547.321378:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463547.321447:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.321486:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618877e1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.321528:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831680 00000100:00100000:2.0:1788463547.321535:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831680 00000100:00100000:2.0:1788463547.321604:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463547.321612:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+11:17035:x1875339485831680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463547.321625:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463547.321636:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e27200/0x841acb7f42a3a908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a901 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321676:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27200/0x841acb7f42a3a908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a901 expref: 12 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321688:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e27200/0x841acb7f42a3a908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a901 expref: 12 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321696:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27200, rc 0) 00000100:00100000:2.0:1788463547.321734:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485831680:12345-0@lo:101:mount.lustre.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.321742:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463547.321792:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463547.321807:0:17035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.321816:0:17035:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463547.322977:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463547.323030:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.323459:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618877e1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.323511:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831808 00000100:00100000:2.0:1788463547.323519:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831808 00000100:00100000:2.0:1788463547.323565:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463547.323572:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485831808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463547.323742:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485831808:12345-0@lo:501:mount.lustre.0 Request processed in 169us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.323751:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463547.323806:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463547.323855:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463547.325538:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.325598:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485831936 00000100:00100000:2.0:1788463547.325606:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485831936 00000100:00100000:2.0:1788463547.325647:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788463547.325655:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485831936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463547.325763:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485831936:12345-0@lo:503:mount.lustre.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.325772:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788463547.325822:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618877e1840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.325843:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485831936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463547.332666:0:17086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.332758:0:17086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.332809:0:17086:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463547.332964:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832064 00000100:00100000:0.0:1788463547.332980:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832064 00000100:00100000:0.0:1788463547.333034:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463547.333452:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463547.333630:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832064:12345-0@lo:502:llog_process_th.0 Request processed in 588us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463547.333639:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463547.335540:0:17086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832064:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788463547.335639:0:17086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788463547.335655:0:17086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff96188d3a19c0) 00000020:00000080:2.0:1788463547.335681:0:17086:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788463547.335774:0:17086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96189154b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788463547.335779:0:17086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96189154b000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788463547.335781:0:17086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96189154b000 4 00010000:00080000:2.0:1788463547.335811:0:17086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188f415800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463547.343656:0:17086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788463547.350529:0:17086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788463547.350599:0:17086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463547.350615:0:17086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x841acb7f42a3a916 00000100:00080000:2.0:1788463547.350627:0:17086:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463547.350633:0:17086:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96188f415800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463547.350676:0:17086:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa19880 x1875339485832192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463547.350710:0:17086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788463547.351748:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485832192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463547.351846:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.352988:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832192 00000100:00100000:0.0:1788463547.353001:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832192 00000100:00100000:0.0:1788463547.353038:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463547.353246:0:17086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.353307:0:17086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.353334:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832320 00000100:00100000:2.0:1788463547.353338:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832320 00000100:00100000:0.0:1788463547.353817:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485832192:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463547.353955:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463547.353965:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463547.354148:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485832192:12345-0@lo:38:llog_process_th.0 Request processed in 333us (2301us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788463547.354157:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463547.355316:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463547.355329:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463547.355334:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788463547.355338:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485832192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463547.356005:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832320:12345-0@lo:502:llog_process_th.0 Request processed in 2038us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.356020:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463547.356488:0:17086:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.356519:0:17086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.356633:0:17086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.356685:0:17086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.356715:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832448 00000100:00100000:2.0:1788463547.356720:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832448 00000100:00100000:2.0:1788463547.356768:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463547.356777:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463547.359553:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17086:x1875339485832448:12345-0@lo:502:llog_process_th.0 Request processed in 2768us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.359570:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463547.359668:0:17086:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.359697:0:17086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:61537c78-f571-4169-84d6-9d8a2058e62c:17086:1875339485832448:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788463547.359733:0:17086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788463547.359815:0:17035:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788463547.359837:0:17035:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463547.359856:0:17035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463547.359870:0:17035:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e27000/0x841acb7f42a3a901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a908 expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788463547.359920:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788463547.359922:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463547.359923:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463547.359925:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463547.359926:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463547.359928:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463547.359929:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463547.359930:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463547.359932:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463547.359939:0:17035:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463547.359944:0:17035:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788463547.359946:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463547.359947:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463547.359948:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463547.359949:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463547.359950:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463547.359951:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463547.359952:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463547.359953:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463547.359954:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463547.359955:0:17035:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463547.359978:0:17035:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788463547.359995:0:17035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485832576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463547.360036:0:17035:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463547.360055:0:17035:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463547.360095:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832576 00000100:00100000:2.0:1788463547.360101:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832576 00000100:00100000:2.0:1788463547.360136:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463547.360145:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485832576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463547.360169:0:17050:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788463547.360183:0:17050:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788463547.367680:0:17050:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788463547.367705:0:17050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788463547.368139:0:17072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788463547.368146:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788463547.368169:0:17072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.368188:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.368197:0:17072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.368237:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.368262:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 12 pid: 17051 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.368275:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485832704:0@lo:104: 00000100:00100000:0.0:1788463547.369000:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463547.369061:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618829c6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463547.369278:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832704 00000100:00100000:3.0:1788463547.369288:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832704 00000100:00100000:3.0:1788463547.369333:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463547.369348:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485832704:12345-0@lo:104: 00010000:00010000:3.0:1788463547.369377:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369442:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463547.369449:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485832704:12345-0@lo:104: Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.369456:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788463547.369478:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463547.369484:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369491:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdea00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:3.0:1788463547.369495:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369504:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463547.369513:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463547.369518:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463547.369555:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369561:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463547.369599:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369617:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a8e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8ec expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.369635:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463547.369637:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463547.369639:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463547.369669:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485832832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463547.369700:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463547.370207:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832832 00000100:00100000:3.0:1788463547.370214:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832832 00010000:00010000:3.0:1788463547.370233:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 13 pid: 17051 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463547.370256:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463547.370263:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+13:3649:x1875339485832832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463547.370273:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463547.370278:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 13 pid: 17051 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370289:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 13 pid: 17051 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370307:0:17041:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370315:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463547.370330:0:17041:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002185196s 00010000:00010000:3.0:1788463547.370344:0:17041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370351:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370359:0:17041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370378:0:17041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370383:0:17041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463547.370387:0:17041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370394:0:17041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370403:0:17041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463547.370414:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463547.370453:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+13:3649:x1875339485832832:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463547.370460:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463547.370499:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485832832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463547.371185:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:17035:x1875339485832576:12345-0@lo:253:mount.lustre.0 Request processed in 11038us (11146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463547.371196:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463547.371274:0:17035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17035:1875339485832576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463547.371288:0:17035:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788463547.371291:0:17035:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463547.371293:0:17035:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463547.371294:0:17035:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463547.371301:0:17035:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463547.371302:0:17035:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463547.371303:0:17035:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463547.371304:0:17035:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463547.371306:0:17035:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463547.371308:0:17035:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463547.371309:0:17035:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463547.371322:0:17035:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788463547.374061:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdf600/0x841acb7f42a3a8ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3a8e5 expref: 11 pid: 17051 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463547.374095:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485832704:0@lo:104: 00010000:00010000:0.0:1788463547.374119:0:17072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.374130:0:17072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.374137:0:17072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463547.374143:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787bc0000/0x841acb7f42a3a91d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788463547.410414:0:17035:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788463547.423442:0:17035:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788463547.424193:0:17096:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788463547.424199:0:17096:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788463547.425462:0:17035:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:3.0:1788463547.425712:0:17097:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788463547.426250:0:17097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788463547.428699:0:17035:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788463547.428741:0:17035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788463547.429352:0:17035:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788463547.429361:0:17035:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788463547.431012:0:17035:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463547.434922:0:17035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788463547.436790:0:17097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788463547.437783:0:17097:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788463547.438417:0:17035:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788463547.438474:0:17035:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00080000:2.0:1788463547.438894:0:17098:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96188fa1b480 x1875339485832960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463547.438907:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00080000:10000000:2.0:1788463547.440230:0:17035:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788463547.442589:0:17035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788463547.445943:0:17035:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788463547.445989:0:17035:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba47416ef988 00100000:10000000:3.0:1788463547.445998:0:17035:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788463547.452702:0:17035:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463547.452719:0:17035:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463547.452734:0:17035:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788463547.452759:0:17035:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788463547.456710:0:17035:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788463547.456927:0:17035:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788463548.040022:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463548.421177:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463548.488336:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 10000000:01000000:3.0:1788463548.549309:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463548.549316:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96189154b000 from 7 10000000:01000000:3.0:1788463548.549320:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463548.549377:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463548.549390:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463548.549401:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463548.549425:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485833088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463548.549492:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463548.549626:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d09d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463548.558487:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833088 00000100:00100000:2.0:1788463548.558504:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833088 00000100:00100000:2.0:1788463548.558567:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463548.558592:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+11:17054:x1875339485833088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463548.558611:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463548.558630:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a924 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463548.558658:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463548.558686:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463548.558695:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26200, rc 0) 00000100:00100000:2.0:1788463548.558793:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:17054:x1875339485833088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (9300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463548.558800:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463548.558865:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485833088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463548.558885:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463548.558896:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463548.558955:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485833216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788463548.558987:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463548.559016:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463548.559029:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833216 00000100:00100000:1.0:1788463548.559035:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833216 00000100:00100000:1.0:1788463548.559085:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463548.559093:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17054:x1875339485833216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463548.559108:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463548.559124:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463548.559127:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788463548.559211:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17054:x1875339485833216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463548.559220:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463548.559255:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485833216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463548.559302:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463548.559309:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463548.559318:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463549.060287:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463549.456914:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463549.508099:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463550.087800:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463550.531638:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788463551.108879:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463551.430809:0:17340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788463551.559149:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463552.138788:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463552.282172:0:17392:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463552.283072:0:17392:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788463552.388683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788463552.388690:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788463552.388694:0:8:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463552.388703:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1788463552.388709:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463552.388716:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff961786882800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463552.388737:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa19500 x1875339485833472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463552.388771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463552.388774:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463552.388777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463552.388780:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463552.388782:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788463552.388785:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788463552.388787:0:8:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463552.388792:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff96188f415800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463552.388806:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa18700 x1875339485833600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463552.388866:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463552.388878:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485833344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463552.388991:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463552.389053:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833344 00000100:00100000:2.0:1788463552.389060:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833344 00000100:00100000:2.0:1788463552.389101:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463552.389109:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:3651:x1875339485833344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463552.389158:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:3651:x1875339485833344:12345-0@lo:400:kworker.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463552.389164:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463552.389211:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485833344:0@lo:400:kworker.0 00000100:00100000:1.0:1788463552.389640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833472:0@lo:38:kworker.0 00000100:00100000:1.0:1788463552.389693:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463552.389722:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485833600:0@lo:38:kworker.0 00000100:00100000:1.0:1788463552.389748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463552.389782:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833600 00000100:00100000:1.0:1788463552.389786:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833600 00000100:00100000:1.0:1788463552.389809:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463552.389814:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485833600:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788463552.389846:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 591 last 0 00000020:00000080:1.0:1788463552.389884:0:17058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x841acb7f42a3a932 00000004:00100000:1.0:1788463552.389898:0:17058:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463552.390036:0:17058:0:(import.c:65:import_set_state_nolock()) ffff96188f727800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463552.390077:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875339485833600:12345-0@lo:38:kworker.0 Request processed in 262us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463552.390085:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788463552.390118:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96188fa18700 x1875339485833600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788463552.390130:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788463552.390136:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788463552.390141:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788463552.390143:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188f415800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788463552.390149:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875339485833600:0@lo:38:kworker.0 00000100:00100000:2.0:1788463552.390228:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833472 00000100:00100000:2.0:1788463552.390232:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833472 00000100:00100000:2.0:1788463552.390300:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463552.390305:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485833472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788463552.390317:0:17062:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788463552.410760:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485833472:12345-0@lo:38:kworker.0 Request processed in 20444us (21056us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788463552.410776:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788463552.414633:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463552.414646:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788463552.414652:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833472:0@lo:38:kworker.0 00000100:00100000:0.0:1788463552.580632:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00000020:00000004:2.0:1788463553.107034:0:17443:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463553.107206:0:17443:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788463553.159285:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463553.603826:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463554.180148:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463554.631401:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788463555.203805:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463555.655503:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788463556.228799:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463556.675697:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788463557.251829:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463557.507762:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463547/real 1788463547] req@ffff96188d1c3100 x1875339485830528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463557 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463557.507801:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1c3100 x1875339485830528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463557 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463557.507813:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463547/real 1788463547] req@ffff96188d1c2d80 x1875339485830400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463557 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463557.507827:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188d1c2d80 x1875339485830400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463557 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463557.507849:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463557.507863:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463557.507867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830528:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788463557.507873:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463557.507888:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788463557.507892:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485830400:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788463557.508017:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788463557.508022:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788463557.508024:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463557.508029:0:1365:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 591 00000100:00080000:0.0:1788463557.508034:0:1365:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788463557.508040:0:1365:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff961786882800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463557.508062:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf30e00 x1875339485833856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463557.508074:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463557.508077:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788463557.508079:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463557.508082:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:0.0:1788463557.508084:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788463557.508087:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced9800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463557.508097:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf32300 x1875339485833984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463557.508105:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463557.508108:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463557.508110:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463557.508129:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00100000:2.0:1788463557.508133:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485833728:0@lo:400:kworker.0 00000100:00080000:0.0:1788463557.508134:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788463557.508138:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463557.508156:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf32680 x1875339485834112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463557.508207:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485834240:0@lo:400:kworker.0 00000100:00100000:2.0:1788463557.508273:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463557.508301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463557.508345:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833728 00000100:00100000:2.0:1788463557.508353:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833728 00000100:00100000:3.0:1788463557.508403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833856:0@lo:38:kworker.0 00000100:00100000:3.0:1788463557.508441:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463557.508470:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463557.508482:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:3651:x1875339485833728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463557.508509:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834240 00000100:00100000:1.0:1788463557.508515:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834240 00000100:00100000:2.0:1788463557.508542:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:3651:x1875339485833728:12345-0@lo:400:kworker.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463557.508556:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788463557.508556:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463557.508568:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463557.508637:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485834240:12345-0@lo:400:kworker.0 Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463557.508652:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788463557.508695:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96188cf31f80 x1875339485834240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463557.508707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485834240:0@lo:400:kworker.0 00000100:00100000:3.0:1788463557.508856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833984:0@lo:8:kworker.0 00000400:00000100:3.0:1788463557.508901:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485833984 offset 0 length 520: 4 00000100:00100000:3.0:1788463557.508921:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485834112:0@lo:8:kworker.0 00000400:00000100:3.0:1788463557.508938:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485834112 offset 0 length 520: 4 00000100:00100000:3.0:1788463557.508975:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485833728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463557.509101:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485833856 00000100:00100000:1.0:1788463557.509107:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485833856 00000100:00100000:1.0:1788463557.509157:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463557.509162:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485833856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788463557.509197:0:17061:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463557.520256:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485833856:12345-0@lo:38:kworker.0 Request processed in 11084us (11805us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463557.520272:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788463557.520354:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463557.520361:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463557.520365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833856:0@lo:38:kworker.0 00000100:00100000:0.0:1788463557.702631:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788463558.276372:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463558.730191:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:0.0:1788463559.300030:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463559.684273:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463559.747827:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:2.0:1788463560.326886:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463560.773436:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788463561.347773:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463561.796652:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00000020:01000004:3.0:1788463562.303570:0:17788:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463562.303835:0:17788:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788463562.303837:0:17788:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788463562.303952:0:17788:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96188cec8000 00000020:01000004:3.0:1788463562.303968:0:17788:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788463562.303982:0:17788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788463562.303995:0:17788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff961787c9cd40) 00000020:00000080:3.0:1788463562.304011:0:17788:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788463562.374531:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788463562.398372:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788463562.404941:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788463562.411356:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.413372:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.415824:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.416967:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.417344:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.417554:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.417966:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.419476:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.421142:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.422506:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.423010:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.423435:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.423829:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.424150:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.424503:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.425165:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.425511:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.425945:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.426157:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.426816:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.427417:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.427927:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.428948:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.429318:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.429995:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.430936:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.431889:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788463562.432268:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788463562.433050:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788463562.437364:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788463562.437984:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788463562.438380:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788463562.441035:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.441525:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.441921:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.442141:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788463562.442415:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788463562.442631:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.442959:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788463562.443194:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788463562.443453:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.444934:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788463562.445533:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788463562.451153:0:17788:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788463562.453482:0:17788:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788463562.453972:0:17788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788463562.453984:0:17788:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788463562.453996:0:17788:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a940 00000020:01000004:3.0:1788463562.454003:0:17788:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788463562.454024:0:17788:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788463562.454028:0:17788:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788463562.454034:0:17788:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788463562.454063:0:17788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788463562.454067:0:17788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788463562.458382:0:17788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788463562.458426:0:17788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788463562.458430:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788463562.458433:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788463562.458434:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463562.458435:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463562.458437:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463562.458438:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463562.458439:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463562.458441:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463562.458442:0:17788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463562.458446:0:17788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788463562.458448:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463562.458450:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788463562.458451:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463562.458452:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463562.458453:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463562.458455:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463562.458456:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463562.458457:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463562.458458:0:17788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463562.458484:0:17788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788463562.458503:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834368:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788463562.458568:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.458831:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.458984:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834368 00000100:00100000:2.0:1788463562.458992:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834368 00000100:00100000:2.0:1788463562.459098:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463562.459108:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17788:x1875339485834368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463562.459140:0:17049:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788463562.459143:0:17049:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788463562.459151:0:17049:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788463562.459568:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+12:17788:x1875339485834368:12345-0@lo:253:mount.lustre.0 Request processed in 461us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.459600:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463562.459812:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834368:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788463562.459825:0:17788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788463562.459828:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463562.459829:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788463562.459831:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463562.459832:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463562.459833:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463562.459835:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463562.459836:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463562.459837:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463562.459838:0:17788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788463562.459857:0:17788:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96188cec8000 from lustre-MDT0001 10000000:01000000:3.0:1788463562.459888:0:17788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788463562.459898:0:17788:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788463562.459904:0:17788:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96188fbd3380 local copy 00010000:00010000:3.0:1788463562.459914:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.459993:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.460021:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.460044:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.460101:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834496 00000100:00100000:0.0:1788463562.460106:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834496 00000100:00100000:0.0:1788463562.460141:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463562.460148:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:17788:x1875339485834496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463562.460336:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+12:17788:x1875339485834496:12345-0@lo:501:mount.lustre.0 Request processed in 187us (313us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463562.460343:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463562.460452:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834496:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788463562.460464:0:17788:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788463562.460480:0:17788:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788463562.460486:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.460495:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.460513:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96188cec8000 10000000:01000000:3.0:1788463562.460516:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788463562.460520:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96188fbd3380 10000000:01000000:3.0:1788463562.460522:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788463562.460526:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff96188fbd3380 from 1 10000000:01000000:3.0:1788463562.460528:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788463562.460546:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.460555:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.460665:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.460680:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463562.460703:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.460727:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463562.460770:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834624 00000100:00100000:1.0:1788463562.460776:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834624 00000100:00100000:1.0:1788463562.460810:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463562.460817:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+12:17788:x1875339485834624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463562.460826:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463562.460838:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0c600/0x841acb7f42a3a94e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a947 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.460859:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c600/0x841acb7f42a3a94e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a947 expref: 13 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.460876:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0c600/0x841acb7f42a3a94e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a947 expref: 13 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.460885:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c600, rc 0) 00000100:00100000:1.0:1788463562.460919:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+13:17788:x1875339485834624:12345-0@lo:101:mount.lustre.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.460925:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463562.461015:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.461026:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461035:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.461049:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788463562.461063:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461070:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdfc00/0x841acb7f42a3a947 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a94e expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.461084:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96188cec8000 10000000:01000000:3.0:1788463562.461087:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788463562.461090:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff96188cec8000 from 1 10000000:01000000:3.0:1788463562.461092:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788463562.461104:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461111:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461124:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.461135:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463562.461156:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463562.461336:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834752 00000100:00100000:0.0:1788463562.461340:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834752 00000100:00100000:0.0:1788463562.461368:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463562.461374:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+13:17788:x1875339485834752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463562.461381:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463562.461389:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787bc0e00/0x841acb7f42a3a95c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a955 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461407:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787bc0e00/0x841acb7f42a3a95c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a955 expref: 14 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461415:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787bc0e00/0x841acb7f42a3a95c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a955 expref: 14 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461422:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0e00, rc 0) 00000100:00100000:0.0:1788463562.461445:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+14:17788:x1875339485834752:12345-0@lo:101:mount.lustre.0 Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.461450:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463562.461516:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.461528:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.461538:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461545:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.461555:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788463562.461623:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461631:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdea00/0x841acb7f42a3a955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a95c expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.461637:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788463562.461640:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788463562.461644:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96188cec8000 10000000:01000000:3.0:1788463562.461646:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788463562.461648:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788463562.461651:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788463562.461662:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461673:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.461681:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.461692:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463562.461714:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.461729:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.461839:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485834880 00000100:00100000:0.0:1788463562.461843:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485834880 00000100:00100000:0.0:1788463562.461870:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463562.461876:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+14:17788:x1875339485834880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463562.461882:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463562.461889:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787bc0200/0x841acb7f42a3a96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a963 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461902:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787bc0200/0x841acb7f42a3a96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a963 expref: 15 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461910:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787bc0200/0x841acb7f42a3a96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a963 expref: 15 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463562.461916:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc0200, rc 0) 00000100:00100000:0.0:1788463562.461940:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485834880:12345-0@lo:101:mount.lustre.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.461945:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788463562.462155:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485834880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.462166:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.462174:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463562.463953:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788463562.464876:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463562.469543:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788463562.469793:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788463562.469813:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788463562.469828:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788463562.469842:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788463562.469856:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788463562.469869:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788463562.469881:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788463562.469892:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788463562.469905:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788463562.469928:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788463562.469941:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788463562.469953:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788463562.469965:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788463562.469976:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788463562.469988:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788463562.469999:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788463562.470009:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788463562.470020:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788463562.470030:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788463562.470040:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788463562.470051:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788463562.470062:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788463562.470155:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788463562.470161:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788463562.470342:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.470403:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.470448:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.470529:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835008 00000100:00100000:0.0:1788463562.470536:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835008 00000100:00100000:0.0:1788463562.470759:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463562.470769:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463562.470911:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835008:12345-0@lo:501:mount.lustre.0 Request processed in 143us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.470918:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463562.471130:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.471163:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463562.471211:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.471427:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.471492:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835136 00000100:00100000:2.0:1788463562.471497:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835136 00000100:00100000:2.0:1788463562.471521:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463562.471528:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463562.472319:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835136:12345-0@lo:503:mount.lustre.0 Request processed in 788us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.472328:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788463562.472410:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463562.472828:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463562.472900:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.472944:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.472972:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.473167:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835264 00000100:00100000:2.0:1788463562.473173:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835264 00000100:00100000:2.0:1788463562.473292:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463562.473300:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463562.473920:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835264:12345-0@lo:502:mount.lustre.0 Request processed in 619us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.473929:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788463562.474172:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463562.474483:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788463562.474512:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788463562.474526:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788463562.474539:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788463562.474551:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788463562.474565:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788463562.474598:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788463562.474699:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788463562.474713:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788463562.474726:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788463562.474738:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788463562.474750:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788463562.474762:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788463562.474774:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788463562.474800:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788463562.474817:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788463562.474830:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788463562.474841:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788463562.474853:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788463562.474866:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788463562.474879:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788463562.474890:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788463562.474903:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788463562.474915:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788463562.474927:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788463562.474938:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788463562.474950:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788463562.474962:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788463562.474974:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788463562.474986:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788463562.474998:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788463562.475012:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788463562.475037:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788463562.475052:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788463562.475064:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788463562.476324:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788463562.476361:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788463562.476376:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788463562.476394:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788463562.476408:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788463562.476423:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788463562.476437:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788463562.476451:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788463562.476464:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788463562.476511:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.477018:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.477295:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835392 00000100:00100000:2.0:1788463562.477303:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835392 00000100:00100000:2.0:1788463562.477357:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463562.477367:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463562.477484:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485835392:12345-0@lo:502:mount.lustre.0 Request processed in 118us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.477499:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463562.477550:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.477845:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485835392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463562.477920:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788463562.477930:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788463562.478886:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463562.478900:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463562.478901:0:17792:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788463562.478908:0:17792:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788463562.478911:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463562.478926:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9618831e4d40) 00000020:00000080:1.0:1788463562.478946:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788463562.478952:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788463562.479029:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788463562.479036:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a978 00000020:00000080:1.0:1788463562.479402:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788463562.479407:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463562.479411:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463562.479412:0:17792:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788463562.479415:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463562.479418:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463562.479420:0:17792:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788463562.479423:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463562.479430:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9618831e0000) 00000020:00000080:1.0:1788463562.479440:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788463562.479444:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788463562.479446:0:17792:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788463562.479448:0:17792:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788463562.479460:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788463562.479507:0:17792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188cec8000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788463562.479519:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9618831e3380) 00000020:00000080:1.0:1788463562.479528:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788463562.479751:0:17792:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788463562.479759:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3a98d 00000020:00000080:1.0:1788463562.479865:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788463562.479872:0:17792:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788463562.479876:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x841acb7f42a3a994 00080000:01000000:1.0:1788463562.479882:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788463562.479885:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a99b 00010000:00010000:3.0:1788463562.547879:0:17792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788463562.548379:0:17792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788463562.548700:0:17792:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788463562.549635:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788463562.549649:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463562.549656:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463562.549659:0:17792:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788463562.549663:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463562.549669:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463562.549670:0:17792:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788463562.549673:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463562.549679:0:17792:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:00000080:1.0:1788463562.549707:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463562.549722:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9618831e19c0) 00000020:00000080:1.0:1788463562.549744:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788463562.549749:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463562.549821:0:17792:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788463562.549828:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788463562.549834:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a9a9 00010000:00080000:1.0:1788463562.549864:0:17792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96189154e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:1.0:1788463562.551415:0:17792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788463562.557677:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463562.557695:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788463562.557740:0:17792:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788463562.557764:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3a9b0 00000100:00080000:3.0:1788463562.557775:0:17792:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463562.557793:0:17792:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96189154e000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463562.557834:0:17792:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e19880 x1875339485835520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463562.557859:0:17792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463562.557968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485835520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463562.558038:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.558228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485835648:0@lo:400:kworker.0 00000100:00100000:2.0:1788463562.558266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788463562.558339:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463562.558344:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558346:0:17792:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788463562.558351:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788463562.558354:0:17792:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788463562.558355:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.558357:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.558358:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788463562.558360:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558362:0:17792:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788463562.558365:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463562.558370:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558371:0:17792:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788463562.558375:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788463562.558418:0:17792:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788463562.558437:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463562.558440:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558441:0:17792:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788463562.558444:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788463562.558446:0:17792:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788463562.558447:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.558448:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.558450:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788463562.558460:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558462:0:17792:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788463562.558466:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463562.558469:0:17792:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788463562.558473:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.558474:0:17792:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788463562.558477:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463562.558481:0:17792:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:2.0:1788463562.558500:0:17792:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788463562.558502:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463562.558515:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff96188d3a4d40) 00000020:00000080:2.0:1788463562.558527:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788463562.558532:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463562.558613:0:17792:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788463562.558620:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788463562.558625:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a9be 00010000:00080000:2.0:1788463562.558652:0:17792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961883731000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463562.558887:0:17792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788463562.559136:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835520 00000100:00100000:2.0:1788463562.559143:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835520 00000100:00100000:0.0:1788463562.559228:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835648 00000100:00100000:0.0:1788463562.559233:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835648 00000100:00100000:0.0:1788463562.559271:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463562.559280:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+15:3649:x1875339485835648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463562.559346:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+15:3649:x1875339485835648:12345-0@lo:400:kworker.0 Request processed in 67us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.559354:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463562.559409:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485835648:0@lo:400:kworker.0 00000100:00080000:3.0:1788463562.561261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788463562.561270:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788463562.561273:0:36:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463562.561288:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:3.0:1788463562.561293:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788463562.561299:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff961786882800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463562.561335:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1b100 x1875339485835776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463562.561358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463562.561362:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788463562.561365:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463562.561368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463562.561401:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463562.561415:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485835904:0@lo:400:kworker.0 00000100:00100000:3.0:1788463562.561476:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.561515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485835776:0@lo:38:kworker.0 00000100:00100000:3.0:1788463562.561540:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.561603:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835904 00000100:00100000:1.0:1788463562.561610:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835904 00000100:00100000:1.0:1788463562.561650:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463562.561658:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485835904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463562.561713:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485835904:12345-0@lo:400:kworker.0 Request processed in 55us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.561721:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788463562.561756:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff961787e18e00 x1875339485835904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463562.561770:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485835904:0@lo:400:kworker.0 00000100:00100000:2.0:1788463562.562486:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485835776 00000100:00100000:2.0:1788463562.562493:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485835776 00000100:00100000:2.0:1788463562.562515:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463562.562521:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485835520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463562.562544:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000040:01000000:3.0:1788463562.563168:0:17792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788463562.563355:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000020:00000080:2.0:1788463562.564537:0:17062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3a9c5 00000004:00100000:2.0:1788463562.564558:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788463562.564565:0:17062:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1788463562.565403:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463562.565747:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788463562.565875:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1788463562.573704:0:17062:0:(import.c:65:import_set_state_nolock()) ffff961883734000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463562.573809:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485835520:12345-0@lo:38:llog_process_th.0 Request processed in 11284us (15768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.573828:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463562.573855:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463562.573862:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485835776:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788463562.573905:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3647:x1875339485835776:12345-0@lo:38:kworker.0 Request processed in 42us (12364us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788463562.573911:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463562.574044:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463562.574053:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463562.574057:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788463562.574061:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485835776:0@lo:38:kworker.0 00000100:00100000:3.0:1788463562.574091:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463562.574097:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788463562.574111:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788463562.574116:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788463562.574119:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96189154e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788463562.574139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485835520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463562.574288:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463562.574303:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485836032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463562.574344:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.574386:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836032 00000100:00100000:1.0:1788463562.574393:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836032 00000100:00100000:1.0:1788463562.574424:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463562.574430:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485836032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463562.574451:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463562.574486:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485836032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.574492:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463562.574519:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485836032:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788463562.574902:0:17797:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788463562.574906:0:17797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788463562.575675:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788463562.575847:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788463562.575888:0:17792:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788463562.575907:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3a9cc 00000100:00080000:2.0:1788463562.575916:0:17792:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463562.575921:0:17792:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff961883731000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463562.575950:0:17792:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa18a80 x1875339485836160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463562.576000:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485836160:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788463562.576041:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485836160 offset 0 length 520: 4 00000100:00080000:2.0:1788463562.576143:0:17792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788463562.576238:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463562.576242:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.576244:0:17792:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788463562.576247:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788463562.576249:0:17792:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788463562.576251:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.576253:0:17792:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463562.576254:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788463562.576256:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.576258:0:17792:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788463562.576260:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463562.576264:0:17792:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788463562.576266:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463562.576268:0:17792:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788463562.576280:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463562.576283:0:17792:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.153@tcp to nid 0x20000c0a8cc99 (192.168.204.153@tcp) 00000020:01000000:2.0:1788463562.576302:0:17792:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788463562.576304:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463562.576315:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff96188d3a0000) 00000020:00000080:2.0:1788463562.576329:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788463562.576334:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463562.576389:0:17792:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788463562.576396:0:17792:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788463562.576402:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x841acb7f42a3a9da 00010000:00080000:2.0:1788463562.576428:0:17792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961891880800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463562.576662:0:17792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788463562.576989:0:17792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788463562.577003:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788463562.585091:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788463562.585836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463562.585842:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463562.585845:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463562.585848:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788463562.585989:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788463562.586162:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788463562.586516:0:17799:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788463562.586521:0:17799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788463562.587286:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788463562.587298:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788463562.587338:0:17792:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788463562.587357:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3a9e1 00000100:00080000:3.0:1788463562.587367:0:17792:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463562.587374:0:17792:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463562.587408:0:17792:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e19880 x1875339485836288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463562.587431:0:17792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788463562.587494:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463562.587499:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463562.587500:0:17792:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788463562.587503:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463562.587507:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463562.587508:0:17792:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463562.587511:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463562.587513:0:17792:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463562.587515:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463562.587517:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463562.587518:0:17792:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788463562.587521:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463562.587523:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463562.587525:0:17792:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463562.587537:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788463562.587559:0:17792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463562.587562:0:17792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463562.587563:0:17792:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463562.587566:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788463562.587669:0:17788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788463562.587824:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788463562.587842:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.587854:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdf800/0x841acb7f42a3a963 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a96a expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.587863:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188cec8000 from 1 10000000:01000000:3.0:1788463562.587865:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463562.587890:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.587898:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.587909:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.587927:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463562.587988:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.588022:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.588045:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836416 00000100:00100000:3.0:1788463562.588052:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836416 00000100:00080000:1.0:1788463562.588171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463562.588176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463562.588179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463562.588182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788463562.588350:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463562.588361:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+15:17788:x1875339485836416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.588380:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463562.588393:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a9e8 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.588418:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 16 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.588429:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 16 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.588438:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde600, rc 0) 00000100:00100000:3.0:1788463562.588479:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+16:17788:x1875339485836416:12345-0@lo:101:mount.lustre.0 Request processed in 120us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.588486:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463562.588532:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.588547:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.588556:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463562.589186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485836288:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788463562.589226:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485836288 offset 0 length 520: 4 00000100:00100000:3.0:1788463562.590346:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836544:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788463562.590402:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.591158:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c66540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.591221:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836544 00000100:00100000:0.0:1788463562.591230:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836544 00000100:00100000:0.0:1788463562.591282:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788463562.591291:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+16:17788:x1875339485836544:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788463562.591314:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788463562.591334:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463562.591337:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788463562.591638:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+16:17788:x1875339485836544:12345-0@lo:256:mount.lustre.0 Request processed in 346us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.591646:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463562.594171:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836544:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788463562.595259:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463562.595290:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.595305:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463562.595315:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188cec8000 from 1 10000000:01000000:1.0:1788463562.595318:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463562.595371:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.595379:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.595390:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463562.595412:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463562.595472:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.595521:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.595676:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836672 00000100:00100000:2.0:1788463562.595685:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836672 00000100:00100000:2.0:1788463562.595749:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463562.595759:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+16:17788:x1875339485836672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463562.595772:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463562.595798:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3a9f6 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.595823:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.595833:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.595854:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27400, rc 0) 00000100:00100000:2.0:1788463562.595895:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485836672:12345-0@lo:101:mount.lustre.0 Request processed in 137us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.595902:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788463562.596196:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463562.596212:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463562.596221:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463562.596381:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463562.596415:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463562.596444:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.596463:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.596668:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836800 00000100:00100000:0.0:1788463562.596674:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836800 00000100:00100000:0.0:1788463562.596810:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463562.596819:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485836800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463562.596910:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485836800:12345-0@lo:501:mount.lustre.0 Request processed in 93us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.596917:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463562.597008:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463562.597035:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463562.597082:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.597107:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.597200:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485836928 00000100:00100000:0.0:1788463562.597205:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485836928 00000100:00100000:0.0:1788463562.597233:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463562.597239:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485836928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463562.597319:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485836928:12345-0@lo:503:mount.lustre.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.597326:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463562.597491:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485836928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788463562.598272:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463562.598360:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463562.598409:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.598486:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.599453:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837056 00000100:00100000:2.0:1788463562.599533:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837056 00000100:00100000:3.0:1788463562.600012:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463562.600023:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485837056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.600391:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485837056:12345-0@lo:502:mount.lustre.0 Request processed in 368us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.600406:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463562.600853:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463562.601111:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788463562.601142:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788463562.601157:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788463562.601312:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788463562.601330:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788463562.601342:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788463562.601354:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788463562.601365:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788463562.601377:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788463562.601391:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788463562.601404:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788463562.601436:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463562.602039:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463562.602124:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188fb77300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.602162:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837184 00000100:00100000:2.0:1788463562.602307:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837184 00000100:00100000:2.0:1788463562.602403:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463562.602414:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485837184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463562.603067:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485837184:12345-0@lo:502:mount.lustre.0 Request processed in 652us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.603075:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788463562.603347:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463562.603424:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788463562.603436:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788463562.604956:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463562.604968:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.604970:0:17801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788463562.604979:0:17801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188cec8000 00000020:00000080:0.0:1788463562.604982:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463562.604990:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463562.604993:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.604994:0:17801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788463562.604996:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463562.604998:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605000:0:17801:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788463562.605003:0:17801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188cec8000 00000020:00000080:0.0:1788463562.605005:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463562.605066:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463562.605069:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605071:0:17801:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788463562.605073:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463562.605076:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605077:0:17801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463562.605080:0:17801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188cec8000 00000020:00000080:0.0:1788463562.605082:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463562.605098:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463562.605101:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605102:0:17801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463562.605104:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463562.605106:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605107:0:17801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788463562.605111:0:17801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188cec8000 00000020:00000080:0.0:1788463562.605113:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463562.605130:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463562.605133:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463562.605134:0:17801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788463562.605137:0:17801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788463562.614790:0:17788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788463562.614839:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463562.614861:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.614875:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463562.614967:0:17788:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788463562.614970:0:17788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96188cec8000 10000000:01000000:3.0:1788463562.614973:0:17788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96188cec8000 10000000:01000000:3.0:1788463562.614977:0:17788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788463562.614983:0:17788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188cec8000 from 1 10000000:01000000:3.0:1788463562.614986:0:17788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788463562.615021:0:17788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.615030:0:17788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.615041:0:17788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.615064:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463562.615130:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.615167:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837312 00000100:00100000:3.0:1788463562.615539:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837312 00000100:00100000:3.0:1788463562.616559:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463562.616594:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17788:x1875339485837312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.616734:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463562.616753:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdfa00/0x841acb7f42a3aa0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa04 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.616792:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdfa00/0x841acb7f42a3aa0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa04 expref: 18 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.616804:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdfa00/0x841acb7f42a3aa0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa04 expref: 18 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.616814:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdfa00, rc 0) 00000100:00100000:3.0:1788463562.616879:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837312:12345-0@lo:101:mount.lustre.0 Request processed in 304us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.616887:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463562.616945:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.616971:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463562.616989:0:17788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.616998:0:17788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463562.625787:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788463562.627310:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463562.627547:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788463562.627626:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788463562.627643:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788463562.627658:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788463562.627682:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788463562.627695:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788463562.627709:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788463562.627722:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788463562.627734:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788463562.627747:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788463562.627759:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788463562.633295:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788463562.633321:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788463562.633335:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788463562.633348:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788463562.633362:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788463562.633376:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788463562.633412:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788463562.633427:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788463562.633441:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788463562.633453:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788463562.633465:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788463562.633478:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788463562.633493:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788463562.633507:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788463562.633519:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788463562.633532:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788463562.633545:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788463562.633596:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788463562.633617:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788463562.633732:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.633816:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.633865:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837440 00000100:00100000:3.0:1788463562.633873:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837440 00000100:00100000:3.0:1788463562.633920:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463562.633929:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.634064:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837440:12345-0@lo:501:mount.lustre.0 Request processed in 135us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.634084:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463562.634130:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.634151:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463562.634180:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463562.634217:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.634239:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837568 00000100:00100000:3.0:1788463562.634243:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837568 00000100:00100000:3.0:1788463562.634264:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463562.634270:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463562.634331:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837568:12345-0@lo:503:mount.lustre.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.634338:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463562.634368:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.634380:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463562.634789:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463562.634851:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.634886:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.634909:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837696 00000100:00100000:3.0:1788463562.634914:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837696 00000100:00100000:3.0:1788463562.634937:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463562.634943:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.635019:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837696:12345-0@lo:502:mount.lustre.0 Request processed in 75us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.635032:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463562.635065:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.635079:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463562.635239:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788463562.635264:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788463562.635281:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788463562.635294:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788463562.635307:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788463562.635319:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788463562.635332:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788463562.635348:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788463562.635360:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788463562.635374:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788463562.635389:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788463562.635404:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788463562.635419:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788463562.635434:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788463562.635449:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788463562.635463:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788463562.635479:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788463562.635493:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788463562.635520:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788463562.635536:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788463562.635550:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788463562.635564:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788463562.635601:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788463562.635619:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788463562.635630:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788463562.635641:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788463562.635654:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788463562.635679:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788463562.635697:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788463562.635709:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788463562.635719:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788463562.635730:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788463562.635742:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788463562.635754:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788463562.635794:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788463562.635814:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788463562.635826:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788463562.635839:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788463562.635852:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788463562.635865:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788463562.635879:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788463562.635891:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788463562.635903:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788463562.635916:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788463562.635929:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788463562.635940:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788463562.635955:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788463562.635967:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788463562.636002:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.647332:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.647390:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b3265a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.647537:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837824 00000100:00100000:0.0:1788463562.647554:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837824 00000100:00100000:0.0:1788463562.647642:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788463562.647652:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463562.647797:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837824:12345-0@lo:502:mount.lustre.0 Request processed in 147us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.647806:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463562.648019:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463562.648403:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788463562.648444:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788463562.648493:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463562.648535:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.651757:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff961889caf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463562.656276:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485837952 00000100:00100000:0.0:1788463562.656294:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485837952 00000100:00100000:0.0:1788463562.656358:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463562.656371:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463562.657771:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485837952:12345-0@lo:502:mount.lustre.0 Request processed in 1396us (9229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463562.657796:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463562.658733:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485837952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463562.658852:0:17788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788463562.658866:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788463562.661879:0:17806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788463562.661898:0:17806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96188d3a3380) 00000020:00000080:2.0:1788463562.661923:0:17806:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788463562.662021:0:17806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188cec8000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788463562.662025:0:17806:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188cec8000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788463562.662028:0:17806:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cec8000 3 00010000:00080000:2.0:1788463562.662059:0:17806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96188cf2a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.153@tcp at head 00010000:00010000:2.0:1788463562.666484:0:17806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788463562.666796:0:17806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788463562.666841:0:17806:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463562.666869:0:17806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x841acb7f42a3aa19 00000100:00080000:2.0:1788463562.666882:0:17806:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463562.666889:0:17806:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff96188cf2a000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463562.666926:0:17806:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa19880 x1875339485838080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463562.666957:0:17806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463562.667210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485838080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463562.667285:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788463562.667858:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463562.667864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463562.667867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463562.667869:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788463562.667894:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838080 00000100:00100000:1.0:1788463562.667901:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838080 00000100:00100000:1.0:1788463562.667936:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463562.667945:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485838080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788463562.667970:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000020:00000080:1.0:1788463562.668003:0:17058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x841acb7f42a3aa20 00000004:00100000:1.0:1788463562.668020:0:17058:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463562.668050:0:17058:0:(import.c:65:import_set_state_nolock()) ffff9618ad68c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463562.668126:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875339485838080:12345-0@lo:38:llog_process_th.0 Request processed in 180us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.668133:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788463562.668436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96188fa19880 x1875339485838080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463562.668448:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463562.668456:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788463562.668476:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788463562.668481:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788463562.668491:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188cf2a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788463562.668498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875339485838080:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788463562.673399:0:17806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788463562.680710:0:17788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788463562.680766:0:17788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463562.680796:0:17788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.680809:0:17788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde800/0x841acb7f42a3aa04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa0b expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788463562.680885:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788463562.680888:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788463562.680889:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463562.680890:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463562.680892:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463562.680893:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463562.680895:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463562.680897:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463562.680898:0:17788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463562.680902:0:17788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788463562.680905:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463562.680907:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788463562.680908:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463562.680909:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463562.680910:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463562.680911:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463562.680912:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463562.680913:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463562.680914:0:17788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463562.680943:0:17788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788463562.680966:0:17788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485838208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463562.681039:0:17788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.681093:0:17788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b22546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463562.681476:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838208 00000100:00100000:3.0:1788463562.681485:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838208 00000100:00100000:3.0:1788463562.681535:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788463562.681544:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485838208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788463562.681570:0:17051:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788463562.681617:0:17051:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788463562.683983:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788463562.684055:0:17051:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463562.684079:0:17051:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788463562.684415:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17788:x1875339485838208:12345-0@lo:253:mount.lustre.0 Request processed in 2866us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.684427:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:2.0:1788463562.684546:0:17072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463562.684552:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463562.684606:0:17072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684622:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684631:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684639:0:17072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684675:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684690:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 17 pid: 17050 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463562.684705:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485838336:0@lo:104: 00000100:00100000:2.0:1788463562.684742:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463562.684788:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684796:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463562.684804:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485838464:0@lo:104: 00000100:00100000:2.0:1788463562.684825:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.684843:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b2254480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.684873:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838336 00000100:00100000:2.0:1788463562.684881:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838336 00000100:00100000:2.0:1788463562.684913:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838464 00000100:00100000:2.0:1788463562.684916:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838464 00000100:00100000:2.0:1788463562.684929:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463562.684937:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485838336:12345-0@lo:104: 00010000:00010000:2.0:1788463562.684949:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.684990:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463562.684996:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485838336:12345-0@lo:104: Request processed in 60us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.685002:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463562.685014:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463562.685020:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485838464:12345-0@lo:104: 00010000:00010000:2.0:1788463562.685026:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685054:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463562.685059:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485838464:12345-0@lo:104: Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.685064:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463562.685109:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485838336:0@lo:104: 00000100:00100000:2.0:1788463562.685118:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485838464:0@lo:104: 00010000:00010000:2.0:1788463562.685136:0:17072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685152:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463562.685165:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685321:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463562.685325:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685334:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463562.685342:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463562.685348:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463562.685372:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685378:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463562.685399:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685405:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdf600/0x841acb7f42a3a9e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9ef expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685419:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463562.685423:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685428:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463562.685430:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685447:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463562.685452:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463562.685457:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463562.685470:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685475:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463562.685481:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685487:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bde000/0x841acb7f42a3a924 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a92b expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463562.685502:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463562.685503:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463562.685505:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463562.685516:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485838592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463562.685545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.685563:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463562.685567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485838720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463562.685666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.685707:0:17788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:17788:1875339485838208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463562.685718:0:17788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788463562.685726:0:17788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463562.685728:0:17788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788463562.685729:0:17788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463562.685730:0:17788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463562.685731:0:17788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463562.685733:0:17788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463562.685734:0:17788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463562.685736:0:17788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463562.685737:0:17788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463562.685749:0:17788:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788463562.686371:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463562.686393:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838592 00000100:00100000:3.0:1788463562.686401:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838592 00010000:00010000:3.0:1788463562.686433:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 18 pid: 17050 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.686466:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838720 00000100:00100000:3.0:1788463562.686469:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838720 00010000:00010000:3.0:1788463562.686480:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 19 pid: 17051 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463562.686492:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463562.686500:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+19:3648:x1875339485838592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463562.686513:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463562.686518:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 19 pid: 17050 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686529:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 19 pid: 17050 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686556:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde600/0x841acb7f42a3a9ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3a9e8 expref: 19 pid: 17050 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686569:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463562.686642:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+18:3648:x1875339485838592:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.686650:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463562.686666:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463562.686673:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+17:3648:x1875339485838720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463562.686682:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463562.686686:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686695:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686705:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26200/0x841acb7f42a3a92b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3a924 expref: 17 pid: 17051 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686716:0:17041:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686725:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463562.686739:0:17041:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002188183s 00010000:00010000:3.0:1788463562.686744:0:17041:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686761:0:17041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686768:0:17041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686774:0:17041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686792:0:17041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463562.686796:0:17041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686804:0:17041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686819:0:17041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686829:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463562.686853:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+16:3648:x1875339485838720:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463562.686859:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463562.686898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485838720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463562.686907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485838592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463562.686931:0:17072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686939:0:17072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463562.686951:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3aa27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788463562.709261:0:17788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788463562.709391:0:17812:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788463562.709396:0:17812:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788463562.709753:0:17813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788463562.710094:0:17788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788463562.710442:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463562.710749:0:17814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485838848:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788463562.710849:0:17814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.710896:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838848 00000100:00100000:2.0:1788463562.710904:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838848 00000100:00100000:2.0:1788463562.710945:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463562.710955:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485838848:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788463562.711408:0:17788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788463562.711446:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788463562.711890:0:17788:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788463562.711898:0:17788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788463562.711931:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463562.712970:0:17788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788463562.715118:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788463562.715206:0:17813:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788463562.715711:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485838848:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4752us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463562.715722:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463562.715801:0:17814:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463562.715833:0:17814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485838848:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788463562.715877:0:17814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788463562.715929:0:17814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485838976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788463562.715969:0:17814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463562.715996:0:17814:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afe3c0 going to sleep for 11 seconds 00000040:00080000:0.0:1788463562.716628:0:17788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788463562.716697:0:17788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788463562.716834:0:17788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788463562.720330:0:17788:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1788463562.725538:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485838976 00000100:00100000:1.0:1788463562.725552:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485838976 00000100:00100000:1.0:1788463562.725628:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463562.725639:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485838976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788463562.725839:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485838976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 201us (9868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.725848:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463562.727730:0:17814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485838976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463562.727849:0:17814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17814:1875339485839104:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788463562.727907:0:17814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.727954:0:17814:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463562.728092:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839104 00000100:00100000:1.0:1788463562.728099:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839104 00000100:00100000:1.0:1788463562.728149:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463562.728158:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17814:x1875339485839104:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788463562.728209:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17814:x1875339485839104:12345-0@lo:900:lod0001_rec0000.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.728217:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788463562.728342:0:17814:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff961787e18380 x1875339485839104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463578 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463562.728354:0:17814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17814:1875339485839104:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788463562.728402:0:17814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485839232:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788463562.728430:0:17814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463562.728461:0:17814:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463562.730429:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839232 00000100:00100000:1.0:1788463562.730439:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839232 00000100:00100000:1.0:1788463562.730490:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463562.730500:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485839232:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788463562.730633:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17814:x1875339485839232:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 134us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463562.730647:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463562.730755:0:17814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17814:1875339485839232:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788463562.730826:0:17814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463562.732901:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788463562.732992:0:17814:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788463562.732998:0:17814:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1788463562.733360:0:17788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788463562.739108:0:17788:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788463562.739154:0:17788:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba47418f3988 00100000:10000000:0.0:1788463562.739163:0:17788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788463562.740202:0:17788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788463562.740235:0:17788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788463562.740253:0:17788:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788463562.740277:0:17788:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788463562.749480:0:17788:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463562.750175:0:17788:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788463562.821471:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463563.397747:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463563.722271:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788463563.844707:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788463564.420417:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463564.483634:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463564.483646:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188cec8000 from 8 10000000:01000000:3.0:1788463564.483655:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463564.483725:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463564.483761:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463564.483777:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463564.483814:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463564.483911:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463564.484092:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839360 00000100:00100000:1.0:1788463564.484103:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839360 00000100:00100000:3.0:1788463564.484347:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618a0bd1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463564.490442:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463564.490476:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+16:17054:x1875339485839360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463564.490504:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463564.490532:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa2e expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.490602:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.490616:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.490625:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0cc00, rc 0) 00000100:00100000:1.0:1788463564.490734:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485839360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (6824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463564.490753:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463564.490921:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463564.490950:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463564.490961:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463564.491073:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788463564.491134:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463564.491177:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463564.491401:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839488 00000100:00100000:1.0:1788463564.491412:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839488 00000100:00100000:1.0:1788463564.491465:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463564.491473:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485839488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463564.491501:0:17051:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463564.491530:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463564.491533:0:17051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788463564.491665:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485839488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 192us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463564.491673:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463564.491709:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463564.491780:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463564.491790:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.491801:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463564.491813:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463564.491817:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96189154b000 from 8 10000000:01000000:1.0:1788463564.491821:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463564.491851:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.491859:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.491869:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463564.491885:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463564.491917:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463564.491941:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463564.491953:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839616 00000100:00100000:1.0:1788463564.491957:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839616 00000100:00100000:1.0:1788463564.491976:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463564.491982:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485839616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463564.491991:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463564.492003:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa3c expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.492023:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 18 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.492031:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 18 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463564.492040:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463564.492753:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485839616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 757us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463564.492763:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463564.496195:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463564.496239:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463564.496256:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463564.496365:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788463564.496459:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463564.496525:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463564.496775:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839744 00000100:00100000:2.0:1788463564.496786:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839744 00000100:00100000:2.0:1788463564.496847:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463564.496859:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485839744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463564.496885:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463564.496909:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463564.496913:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788463564.497024:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485839744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463564.497033:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463564.497096:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485839744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788463564.497153:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463564.497162:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463564.497172:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463564.746562:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788463564.868710:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463565.445335:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463565.891668:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:3.0:1788463566.467751:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463566.915665:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 0 seconds 00010000:00010000:1.0:1788463567.495071:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463567.748326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788463567.748334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788463567.748338:0:36:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463567.748354:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff961786882800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463567.748377:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188d1c0380 x1875339485840128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463567.748396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463567.748406:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463567.748409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463567.748412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463567.748437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463567.748440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463567.748443:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463567.748446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463567.748473:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485840128:0@lo:38:kworker.0 00000100:00100000:1.0:1788463567.748485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485839872:0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.754850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463567.754928:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485840512:0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.754972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463567.755005:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463567.755012:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485840000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463567.755052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463567.755093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485840256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.755117:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463567.755135:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463567.755141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485840384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.755160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463567.755196:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840512 00000100:00100000:1.0:1788463567.755204:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840512 00000100:00100000:1.0:1788463567.755245:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840256 00000100:00100000:1.0:1788463567.755248:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840256 00000100:00100000:1.0:1788463567.755265:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463567.755280:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.755333:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485840512:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463567.755340:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463567.755358:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463567.755364:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485840256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.755395:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485840256:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463567.755401:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463567.755418:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840000 00000100:00100000:1.0:1788463567.755422:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840000 00000100:00100000:1.0:1788463567.755437:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840384 00000100:00100000:1.0:1788463567.755439:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840384 00000100:00100000:1.0:1788463567.755449:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463567.755456:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485840000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463567.755482:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463567.755515:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875339485840000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463567.755520:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463567.755531:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463567.755537:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485840384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.755563:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485840384:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463567.755569:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463567.755632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485840384:0@lo:400:kworker.0 00010000:00080000:1.0:1788463567.755646:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1c3b80 x1875339485840256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463567.755696:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485840256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463567.755750:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485839872 00000100:00100000:2.0:1788463567.755757:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485839872 00000100:00100000:1.0:1788463567.755764:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485840000:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788463567.755777:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188d1c2d80 x1875339485840512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463567.755786:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485840512:0@lo:400:kworker.0 00000100:00100000:0.0:1788463567.756882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463567.757803:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463567.757826:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:3650:x1875339485839872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463567.757878:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840128 00000100:00100000:1.0:1788463567.757886:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840128 00000100:00100000:2.0:1788463567.757908:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:3650:x1875339485839872:12345-0@lo:400:kworker.0 Request processed in 92us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463567.757920:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788463567.757928:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788463567.757930:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1875339485840128:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788463567.757958:0:17061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:1.0:1788463567.757994:0:17061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3aa4a 00000004:00100000:1.0:1788463567.758019:0:17061:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788463567.758029:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485839872:0@lo:400:kworker.0 00000001:00000004:1.0:1788463567.758137:0:17061:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788463567.772286:0:17061:0:(import.c:65:import_set_state_nolock()) ffff9618add21000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463567.772392:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485840128:12345-0@lo:38:kworker.0 Request processed in 14462us (15511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463567.772403:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788463567.772647:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788463567.772656:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788463567.772662:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788463567.772664:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786882800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788463567.772702:0:3647:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006c9aaff1): req@ffff96188fa1b480 x1875339485832960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463567.772720:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485840128:0@lo:38:kworker.0 00000100:00100000:2.0:1788463567.774113:0:17098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463567.774150:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463567.774167:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485832960 00000100:00100000:2.0:1788463567.774172:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485832960 00000100:00100000:2.0:1788463567.774209:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463567.774217:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485832960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.774285:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485832960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463567.774291:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463567.774324:0:17098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17098:1875339485832960:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788463567.774356:0:17098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788463567.774387:0:17098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17098:1875339485840768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.774414:0:17098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463567.774432:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463567.774441:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840768 00000100:00100000:2.0:1788463567.774444:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840768 00000100:00100000:2.0:1788463567.774459:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463567.774465:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485840768:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.774568:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485840768:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 102us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463567.774626:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485840640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463567.774655:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463567.775419:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463567.775445:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840640 00000100:00100000:2.0:1788463567.775450:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840640 00000100:00100000:2.0:1788463567.775469:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463567.775476:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485840640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463567.775710:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463567.775772:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875339485840640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 297us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463567.775778:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463567.775874:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485840640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463567.775876:0:17098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17098:1875339485840768:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.776747:0:17098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17098:1875339485840896:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.776788:0:17098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463567.776821:0:17098:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891afef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463567.776837:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485840896 00000100:00100000:2.0:1788463567.776841:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485840896 00000100:00100000:2.0:1788463567.776865:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463567.776872:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485840896:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788463567.776926:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17098:x1875339485840896:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463567.776933:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463567.776959:0:17098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17098:1875339485840896:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788463567.777004:0:17098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463567.780434:0:17098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788463567.780860:0:17098:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788463567.780866:0:17098:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1788463567.949036:0:18057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788463568.518807:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788463568.861250:0:18109:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463568.861437:0:18109:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788463569.541509:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463569.925858:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788463569.984032:0:18159:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463569.986703:0:18159:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463570.563777:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463571.233191:0:18207:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe789b7d0 20000000:00000080:0.0:1788463571.233208:0:18207:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9618ad772000 uarg=0000000000000000 20000000:01000000:0.0:1788463571.233253:0:18207:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788463571.233267:0:18207:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788463571.233272:0:18207:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788463571.234038:0:18208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788463571.234188:0:18207:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788463571.249026:0:18207:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788463571.249147:0:18207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249169:0:18207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249176:0:18207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249185:0:18207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249227:0:18207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249253:0:18207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463571.249268:0:18207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18207:1875339485841024:0@lo:104: 00000100:00100000:1.0:1788463571.249337:0:18207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463571.249389:0:18207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463571.249397:0:18207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 17 pid: 17050 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463571.249405:0:18207:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18207:1875339485841152:0@lo:104: 00000100:00100000:1.0:1788463571.249426:0:18207:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463571.249451:0:18207:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902db840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463571.249503:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841024 00000100:00100000:2.0:1788463571.249512:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841024 00000100:00100000:2.0:1788463571.249557:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841152 00000100:00100000:2.0:1788463571.249560:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841152 00000100:00100000:2.0:1788463571.249629:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463571.249638:0:17040:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788463571.249639:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:18207:x1875339485841024:12345-0@lo:104: 00000100:00100000:3.0:1788463571.249646:0:17040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788463571.249653:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249722:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463571.249728:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:18207:x1875339485841024:12345-0@lo:104: Request processed in 90us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463571.249745:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463571.249762:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463571.249768:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:18207:x1875339485841152:12345-0@lo:104: 00010000:00010000:2.0:1788463571.249776:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249810:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463571.249815:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:18207:x1875339485841152:12345-0@lo:104: Request processed in 47us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463571.249820:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788463571.249837:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463571.249843:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249850:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463571.249863:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249872:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463571.249880:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463571.249886:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788463571.249911:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249917:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463571.249936:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249943:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0d400/0x841acb7f42a3a9f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a9fd expref: -99 pid: 17788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249954:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463571.249957:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249963:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdec00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463571.249966:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.249973:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463571.249988:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463571.249994:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788463571.250004:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250009:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463571.250014:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250020:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdec00/0x841acb7f42a3a8f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3a8fa expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250031:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463571.250033:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463571.250034:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463571.250054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485841280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463571.250080:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463571.250100:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463571.250105:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485841408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463571.250120:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463571.250155:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841280 00000100:00100000:2.0:1788463571.250158:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841280 00010000:00010000:2.0:1788463571.250178:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 18 pid: 17051 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463571.250193:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841408 00000100:00100000:2.0:1788463571.250195:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841408 00010000:00010000:2.0:1788463571.250209:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 19 pid: 17050 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463571.250220:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463571.250225:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+19:3648:x1875339485841280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463571.250234:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463571.250239:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 19 pid: 17051 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250249:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 19 pid: 17051 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250262:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463571.250289:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+19:3648:x1875339485841280:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463571.250295:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463571.250305:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463571.250310:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+18:3648:x1875339485841408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463571.250317:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463571.250322:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 18 pid: 17050 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250330:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 18 pid: 17050 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250342:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250350:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250373:0:17042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250382:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250389:0:17042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250395:0:17042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250400:0:17042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463571.250404:0:17042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250412:0:17042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250419:0:17042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463571.250426:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463571.250444:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+18:3648:x1875339485841408:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463571.250450:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463571.250481:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485841408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463571.250488:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485841280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463571.250664:0:18207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27400/0x841acb7f42a3a9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3a9f6 expref: 17 pid: 17051 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463571.250675:0:18207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18207:1875339485841024:0@lo:104: 00010000:00010000:3.0:1788463571.250683:0:18207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bde200/0x841acb7f42a3a8fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3a8f3 expref: 16 pid: 17050 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463571.250691:0:18207:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18207:1875339485841152:0@lo:104: 00010000:00010000:3.0:1788463571.250705:0:18207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463571.250713:0:18207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463571.250719:0:18207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463571.250746:0:18207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0c000/0x841acb7f42a3aa51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463571.253494:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463571.588857:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463572.611867:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463572.803709:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463572.803718:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188cec8000 from 13 10000000:01000000:2.0:1788463572.803724:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463572.803780:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463572.803792:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463572.803803:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463572.803830:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463572.803910:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463572.803970:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463572.804211:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841536 00000100:00100000:1.0:1788463572.804220:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841536 00000100:00100000:1.0:1788463572.804274:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463572.804284:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+16:17054:x1875339485841536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463572.804297:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463572.804310:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa58 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.804334:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.804346:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 17 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.804380:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0ce00, rc 0) 00000100:00100000:1.0:1788463572.804447:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463572.804454:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463572.804804:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463572.804820:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.804829:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463572.804971:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.805002:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.805101:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463572.805202:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841664 00000100:00100000:2.0:1788463572.805207:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841664 00000100:00100000:2.0:1788463572.805281:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463572.805290:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463572.805435:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463572.805442:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788463572.805508:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.805539:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.805626:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.806023:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463572.806102:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841792 00000100:00100000:1.0:1788463572.806109:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841792 00000100:00100000:1.0:1788463572.806142:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788463572.806148:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463572.806287:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463572.806294:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463572.806562:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788463572.808814:0:18269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788463572.808975:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788463572.809000:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463572.809011:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.809022:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463572.809051:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463572.809054:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96189154b000 from 13 10000000:01000000:3.0:1788463572.809056:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463572.809091:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.809100:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.809291:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463572.809317:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.809379:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.809504:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463572.809983:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485841920 00000100:00100000:1.0:1788463572.809992:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485841920 00000100:00100000:1.0:1788463572.810045:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463572.810055:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+17:17054:x1875339485841920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463572.810067:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463572.810080:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa66 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.810104:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 18 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.810246:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 18 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463572.810255:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0dc00, rc 0) 00000100:00100000:1.0:1788463572.810326:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485841920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463572.810332:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463572.810623:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485841920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463572.810641:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.810650:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463572.810716:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485842048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.810747:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.810772:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463572.812699:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485842048 00000100:00100000:0.0:1788463572.812730:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485842048 00000100:00100000:0.0:1788463572.812797:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463572.812808:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485842048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463572.812987:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485842048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463572.812995:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463572.813091:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485842048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.813221:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485842176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463572.813272:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.813308:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cf3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463572.813369:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485842176 00000100:00100000:1.0:1788463572.813374:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485842176 00000100:00100000:1.0:1788463572.813454:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788463572.813463:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485842176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463572.813551:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:17054:x1875339485842176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463572.813558:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463572.813664:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485842176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788463572.817745:0:18270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788463572.817985:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788463572.818015:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463572.818029:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463572.818041:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463572.868220:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463562/real 1788463562] req@ffff961787e19880 x1875339485836288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868252:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e19880 x1875339485836288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868263:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463562/real 1788463562] req@ffff96188fa18a80 x1875339485836160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868274:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188fa18a80 x1875339485836160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868283:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463557/real 1788463557] req@ffff96188cf32300 x1875339485833984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868292:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188cf32300 x1875339485833984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868300:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463557/real 1788463557] req@ffff96188cf32680 x1875339485834112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463572.868309:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96188cf32680 x1875339485834112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463572.868325:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463572.872489:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463572.872504:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485836288:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788463572.872518:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463572.872528:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463572.872532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485836160:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788463572.872538:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463572.872543:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463572.872546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485833984:0@lo:8:kworker.0 00000100:00080000:0.0:1788463572.872550:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463572.872554:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463572.872557:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485834112:0@lo:8:kworker.0 00000100:00100000:0.0:1788463572.872649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485842304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463572.872728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463572.872794:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485842304 00000100:00100000:0.0:1788463572.872803:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485842304 00000100:00100000:0.0:1788463572.872851:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463572.872859:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485842304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463572.872896:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1788463572.873551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463572.873557:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788463572.873560:0:36:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463572.873566:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:3.0:1788463572.873571:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463572.873602:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced9800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463572.873633:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1b480 x1875339485842432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463572.873653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463572.873656:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788463572.873658:0:36:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463572.873661:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:3.0:1788463572.873664:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788463572.873667:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463572.873678:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e19500 x1875339485842560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463572.873769:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485842304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 905us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463572.873778:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788463572.873874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463572.873878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788463572.873880:0:36:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463572.873884:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:3.0:1788463572.873887:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463572.873891:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff961883731000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463572.873903:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1a680 x1875339485842944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463572.873912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463572.873915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788463572.873916:0:36:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463572.873919:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 602 00000100:00080000:3.0:1788463572.873922:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463572.873925:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463572.873948:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e1ad80 x1875339485843072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463572.873983:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485842816:0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874045:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.874070:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463572.874076:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485843200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874102:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.874144:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843200 00000100:00100000:3.0:1788463572.874150:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843200 00000100:00100000:3.0:1788463572.874186:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463572.874227:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485843200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874272:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485843200:12345-0@lo:400:kworker.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463572.874277:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463572.874297:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485842688:0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874319:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463572.874343:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485842688 00000100:00100000:3.0:1788463572.874347:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485842688 00000100:00100000:3.0:1788463572.874368:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463572.874373:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485842688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874403:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485842688:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463572.874409:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788463572.874436:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961787e19f80 x1875339485842688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463572.874448:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485842688:0@lo:400:kworker.0 00010000:00080000:3.0:1788463572.874471:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961787e1aa00 x1875339485843200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463572.874480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485843200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874500:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485842816 00000100:00100000:3.0:1788463572.874504:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485842816 00000100:00100000:3.0:1788463572.874526:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463572.874532:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485842816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874563:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485842816:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463572.874610:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463572.874640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485842816:0@lo:400:kworker.0 00000100:00100000:3.0:1788463572.874658:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485842432:0@lo:8:kworker.0 00000400:00000100:3.0:1788463572.874682:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485842432 offset 0 length 520: 4 00000100:00100000:3.0:1788463572.874705:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485842560:0@lo:8:kworker.0 00000400:00000100:3.0:1788463572.874719:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485842560 offset 0 length 520: 4 00000100:00100000:3.0:1788463572.874728:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485842944:0@lo:8:kworker.0 00000400:00000100:3.0:1788463572.874739:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485842944 offset 0 length 520: 4 00000100:00100000:3.0:1788463572.874748:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485843072:0@lo:8:kworker.0 00000400:00000100:3.0:1788463572.874762:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339485843072 offset 0 length 520: 4 00000100:00100000:0.0:1788463572.875121:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485842304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463572.877323:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463572.877341:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485843328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463572.877402:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463572.877451:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843328 00000100:00100000:1.0:1788463572.877459:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843328 00000100:00100000:1.0:1788463572.877502:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463572.877511:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485843328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463572.877542:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463572.877607:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485843328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463572.877614:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463572.877655:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485843328:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788463573.381171:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788463573.638280:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463574.661668:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463574.980199:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788463575.684095:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463576.707819:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463577.731807:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463577.988261:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485843456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463577.988333:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463577.988879:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463577.988885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463577.988889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463577.988892:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463577.988913:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463577.988917:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463577.988920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463577.988923:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463577.988934:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485843840:0@lo:400:kworker.0 00000100:00100000:0.0:1788463577.988970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463577.989010:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843456 00000100:00100000:0.0:1788463577.989018:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843456 00000100:00100000:0.0:1788463577.989051:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843840 00000100:00100000:0.0:1788463577.989054:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843840 00000100:00100000:0.0:1788463577.989067:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463577.989075:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485843456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463577.989107:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463577.989145:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485843456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463577.989152:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463577.989168:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463577.989174:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485843840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463577.989205:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485843840:12345-0@lo:400:kworker.0 Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463577.989222:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463577.989257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485843840:0@lo:400:kworker.0 00000100:00100000:0.0:1788463577.989286:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463577.989292:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485843968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463577.989315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463577.989827:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485843584:0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.989864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463577.989896:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463577.989903:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485843712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.989925:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463577.989959:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843968 00000100:00100000:3.0:1788463577.989965:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843968 00000100:00100000:3.0:1788463577.989995:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843712 00000100:00100000:3.0:1788463577.989998:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843712 00000100:00100000:3.0:1788463577.990013:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463577.990020:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485843968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.990072:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485843968:12345-0@lo:400:kworker.0 Request processed in 52us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463577.990079:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463577.990093:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463577.990099:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485843712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.990127:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485843712:12345-0@lo:400:kworker.0 Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463577.990133:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788463577.990169:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188cf31500 x1875339485843968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463577.990180:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485843968:0@lo:400:kworker.0 00010000:00080000:3.0:1788463577.990202:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188cf32300 x1875339485843712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463577.990211:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485843712:0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.990237:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485843456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463577.990476:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485843584 00000100:00100000:0.0:1788463577.990493:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485843584 00000100:00100000:0.0:1788463577.990533:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788463577.990541:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:3648:x1875339485843584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463577.990599:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+18:3648:x1875339485843584:12345-0@lo:400:kworker.0 Request processed in 59us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463577.990606:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463577.991156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485843584:0@lo:400:kworker.0 00000100:00100000:3.0:1788463577.994767:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485844096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463577.994857:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463577.995067:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844096 00000100:00100000:0.0:1788463577.995075:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844096 00000100:00100000:0.0:1788463577.995133:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463577.995143:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485844096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463577.995177:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788463577.995232:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485844096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463577.995240:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463577.995285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485844096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463578.755753:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788463578.899358:0:18557:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463578.899362:0:18557:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788463578.899364:0:18557:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788463578.899522:0:18557:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff96188cf2e800 00000020:01000004:3.0:1788463578.899537:0:18557:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788463578.899551:0:18557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788463578.899568:0:18557:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff961787c999c0) 00000020:00000080:3.0:1788463578.899615:0:18557:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788463579.011679:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788463579.022256:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788463579.022796:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788463579.023280:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788463579.023901:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788463579.024549:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788463579.029083:0:18557:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788463579.035600:0:18557:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788463579.035862:0:18557:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788463579.035881:0:18557:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788463579.035898:0:18557:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a3aa7b 00000020:01000004:0.0:1788463579.035907:0:18557:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788463579.035938:0:18557:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788463579.035942:0:18557:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788463579.035948:0:18557:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788463579.035953:0:18557:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788463579.035966:0:18557:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff96188fbd19c0) 00000020:00000080:0.0:1788463579.035976:0:18557:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788463579.037148:0:18557:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463579.037304:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788463579.037311:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788463579.046406:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788463579.046786:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788463579.049721:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788463579.049746:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788463579.064340:0:18557:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463579.069236:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788463579.069245:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788463579.070402:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788463579.070411:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788463579.094326:0:18557:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463579.094714:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463579.094721:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788463579.096495:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788463579.096507:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788463579.097334:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463579.097344:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788463579.099890:0:18557:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463579.100099:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463579.100105:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788463579.101167:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788463579.101182:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000040:00080000:1.0:1788463579.140924:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788463579.152440:0:18557:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463579.152719:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463579.152727:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788463579.154682:0:18557:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463579.154695:0:18557:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788463579.167779:0:18557:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788463579.167813:0:18557:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788463579.167819:0:18557:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788463579.198190:0:18557:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463579.198232:0:18557:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.153@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788463579.198237:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463579.198239:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463579.198240:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463579.198241:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463579.198242:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463579.198244:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463579.198245:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463579.198247:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463579.198248:0:18557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463579.198252:0:18557:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788463579.198254:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463579.198255:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463579.198256:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463579.198257:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463579.198259:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463579.198259:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463579.198260:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463579.198261:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463579.198262:0:18557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463579.198301:0:18557:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788463579.198323:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463579.198393:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.198440:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463579.198507:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844224 00000100:00100000:1.0:1788463579.198515:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844224 00000100:00100000:1.0:1788463579.198605:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463579.198615:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:18557:x1875339485844224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463579.198647:0:17050:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788463579.198650:0:17050:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788463579.198655:0:17050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788463579.199283:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:18557:x1875339485844224:12345-0@lo:253:mount.lustre.0 Request processed in 669us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.199292:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463579.199380:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463579.199392:0:18557:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788463579.199396:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463579.199397:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463579.199398:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463579.199399:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463579.199400:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463579.199401:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463579.199403:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463579.199404:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463579.199412:0:18557:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463579.199430:0:18557:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96188cf2e800 from lustre-OST0000 10000000:01000000:2.0:1788463579.199467:0:18557:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788463579.199470:0:18557:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788463579.199478:0:18557:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96188fbd3380 local copy 00010000:00010000:2.0:1788463579.199487:0:18557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463579.199570:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463579.199636:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.199661:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.200907:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844352 00000100:00100000:3.0:1788463579.200919:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844352 00000100:00100000:3.0:1788463579.201006:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788463579.201017:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:18557:x1875339485844352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463579.201136:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+18:18557:x1875339485844352:12345-0@lo:501:mount.lustre.0 Request processed in 121us (1499us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463579.201144:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463579.201439:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844352:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788463579.201479:0:18557:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788463579.201504:0:18557:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788463579.201512:0:18557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.201520:0:18557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463579.201548:0:18557:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96188cf2e800 10000000:01000000:2.0:1788463579.201553:0:18557:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788463579.201559:0:18557:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788463579.201562:0:18557:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463579.201566:0:18557:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788463579.201569:0:18557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788463579.201625:0:18557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.201633:0:18557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.201649:0:18557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463579.201665:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463579.201703:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.201739:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463579.202481:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844480 00000100:00100000:1.0:1788463579.202490:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844480 00000100:00100000:1.0:1788463579.202534:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463579.202543:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+18:18557:x1875339485844480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463579.202554:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463579.202570:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d400/0x841acb7f42a3aa90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aa89 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463579.202615:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d400/0x841acb7f42a3aa90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aa89 expref: 19 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463579.202626:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d400/0x841acb7f42a3aa90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa89 expref: 19 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463579.202635:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d400, rc 0) 00000100:00100000:1.0:1788463579.202745:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844480:12345-0@lo:101:mount.lustre.0 Request processed in 203us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.202760:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463579.207169:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463579.207202:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463579.207216:0:18557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463579.209180:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788463579.214269:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463579.219163:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788463579.219225:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788463579.219244:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788463579.219258:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788463579.219273:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788463579.219285:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788463579.219313:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788463579.219319:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788463579.219428:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463579.219508:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.219550:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888e23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.220436:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844608 00000100:00100000:0.0:1788463579.220447:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844608 00000100:00100000:0.0:1788463579.220510:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463579.220521:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463579.220752:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844608:12345-0@lo:501:mount.lustre.0 Request processed in 232us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.220760:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788463579.220878:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463579.220931:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463579.221000:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.221037:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.221106:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844736 00000100:00100000:3.0:1788463579.221111:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844736 00000100:00100000:3.0:1788463579.221144:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463579.221152:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463579.221872:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844736:12345-0@lo:503:mount.lustre.0 Request processed in 718us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.221889:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463579.222159:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463579.222669:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463579.222778:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463579.222831:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.222858:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.223297:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844864 00000100:00100000:0.0:1788463579.223304:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844864 00000100:00100000:0.0:1788463579.223358:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463579.223367:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.223948:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844864:12345-0@lo:502:mount.lustre.0 Request processed in 580us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.223956:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788463579.224217:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463579.224507:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788463579.224538:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788463579.224553:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788463579.224568:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788463579.224621:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788463579.224636:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788463579.224647:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788463579.224659:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788463579.224672:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788463579.224698:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788463579.224714:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788463579.224728:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788463579.224770:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463579.224821:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.224853:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d14300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.225308:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485844992 00000100:00100000:0.0:1788463579.225315:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485844992 00000100:00100000:0.0:1788463579.225371:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463579.225380:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.225514:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485844992:12345-0@lo:502:mount.lustre.0 Request processed in 135us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.225522:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463579.225711:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485844992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463579.225829:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788463579.225839:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788463579.235537:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463579.235549:0:18574:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788463579.235557:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463579.235559:0:18574:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788463579.235566:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463579.235701:0:18574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9618916599c0) 00000020:00000080:1.0:1788463579.235733:0:18574:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788463579.235742:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788463579.235889:0:18574:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188cf2e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788463579.235902:0:18574:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788463579.235911:0:18574:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x841acb7f42a3aa9e 00010000:00010000:0.0:1788463579.246016:0:18574:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788463579.247424:0:18574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788463579.252221:0:18574:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788463579.254905:0:18574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788463579.254919:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.254928:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.254930:0:18574:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788463579.254934:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788463579.254937:0:18574:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788463579.254939:0:18574:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463579.254940:0:18574:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463579.254941:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788463579.254945:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.254946:0:18574:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788463579.254949:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.254951:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.254952:0:18574:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463579.254955:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463579.254957:0:18574:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788463579.254959:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.254961:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.254963:0:18574:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788463579.254965:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.254967:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.254968:0:18574:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788463579.254971:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788463579.255019:0:18574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.255022:0:18574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.255023:0:18574:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788463579.255027:0:18574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788463579.255192:0:18557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788463579.255223:0:18557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788463579.255245:0:18557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.255257:0:18557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e26600/0x841acb7f42a3aa89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aa90 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463579.255265:0:18557:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188cf2e800 from 1 10000000:01000000:3.0:1788463579.255267:0:18557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463579.255302:0:18557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.255310:0:18557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.255320:0:18557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463579.255344:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463579.255422:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463579.255481:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f86180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463579.255837:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845120 00000100:00100000:2.0:1788463579.255844:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845120 00000100:00100000:2.0:1788463579.255883:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463579.255892:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+19:18557:x1875339485845120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463579.255906:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463579.255919:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aaa5 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.255943:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 20 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.255954:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 20 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.255963:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27800, rc 0) 00000100:00100000:2.0:1788463579.256861:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845120:12345-0@lo:101:mount.lustre.0 Request processed in 966us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.256871:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788463579.263072:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463579.263106:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.263119:0:18557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463579.264526:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788463579.264974:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463579.265349:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788463579.265375:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788463579.265392:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788463579.265396:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788463579.265491:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463579.265562:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463579.266376:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff96189163ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463579.274635:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845248 00000100:00100000:2.0:1788463579.274651:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845248 00000100:00100000:2.0:1788463579.274703:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463579.274714:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463579.274905:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845248:12345-0@lo:501:mount.lustre.0 Request processed in 192us (9342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.274914:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788463579.275177:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463579.275248:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463579.275298:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.275325:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cee1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.275506:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845376 00000100:00100000:0.0:1788463579.275511:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845376 00000100:00100000:0.0:1788463579.275548:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463579.275558:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463579.275698:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845376:12345-0@lo:503:mount.lustre.0 Request processed in 141us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.275715:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463579.276186:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788463579.276651:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788463579.276743:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463579.276806:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.276835:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cee1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.277156:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845504 00000100:00100000:0.0:1788463579.277163:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845504 00000100:00100000:0.0:1788463579.277197:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463579.277206:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.277304:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845504:12345-0@lo:502:mount.lustre.0 Request processed in 98us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.277312:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463579.277482:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463579.277722:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788463579.277764:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788463579.277780:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788463579.277809:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788463579.277825:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788463579.277839:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788463579.277853:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788463579.277864:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788463579.277877:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788463579.277890:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788463579.277904:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788463579.277931:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463579.279121:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.279174:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cee1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.279919:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845632 00000100:00100000:3.0:1788463579.279931:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845632 00000100:00100000:3.0:1788463579.280006:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788463579.280017:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463579.280174:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845632:12345-0@lo:502:mount.lustre.0 Request processed in 159us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.280182:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788463579.280501:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463579.280636:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788463579.280653:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788463579.288012:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.288029:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.288031:0:18578:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788463579.288040:0:18578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188cf2e800 00000020:00000080:2.0:1788463579.288043:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463579.288050:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.288053:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.288055:0:18578:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788463579.288057:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.288060:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.288061:0:18578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463579.288065:0:18578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff96188cf2e800 00000020:00000080:2.0:1788463579.288067:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463579.289557:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.289567:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.289569:0:18578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788463579.290683:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.290693:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.290695:0:18578:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463579.290701:0:18578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188cf2e800 00000020:00000080:2.0:1788463579.290703:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463579.290816:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.290821:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.290822:0:18578:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463579.290825:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463579.290828:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.290829:0:18578:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788463579.290832:0:18578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96188cf2e800 00000020:00000080:2.0:1788463579.290835:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463579.290875:0:18578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463579.290878:0:18578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463579.290880:0:18578:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788463579.290883:0:18578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788463579.297861:0:18557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788463579.297911:0:18557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463579.297932:0:18557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.297945:0:18557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463579.303179:0:18557:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788463579.303188:0:18557:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96188cf2e800 10000000:01000000:0.0:1788463579.303192:0:18557:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96188cf2e800 10000000:01000000:0.0:1788463579.303196:0:18557:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463579.303202:0:18557:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff96188cf2e800 from 1 10000000:01000000:0.0:1788463579.303205:0:18557:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463579.303251:0:18557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463579.303264:0:18557:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463579.303274:0:18557:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463579.303297:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463579.303366:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.303418:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.303497:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845760 00000100:00100000:3.0:1788463579.303505:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845760 00000100:00100000:3.0:1788463579.303562:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788463579.303606:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:18557:x1875339485845760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463579.303620:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463579.303633:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961786bdf400/0x841acb7f42a3aaba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aab3 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.303657:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf400/0x841acb7f42a3aaba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aab3 expref: 21 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.303668:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961786bdf400/0x841acb7f42a3aaba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aab3 expref: 21 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.303677:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf400, rc 0) 00000100:00100000:3.0:1788463579.303716:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485845760:12345-0@lo:101:mount.lustre.0 Request processed in 114us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.303722:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463579.306490:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463579.306523:0:18557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463579.306545:0:18557:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463579.308183:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788463579.308501:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463579.309279:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788463579.309306:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788463579.309317:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788463579.309328:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788463579.309339:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788463579.309361:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788463579.309373:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788463579.309383:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788463579.309394:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788463579.309404:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788463579.309415:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788463579.309425:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788463579.309436:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788463579.309447:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788463579.309469:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788463579.309482:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788463579.309493:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788463579.309503:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788463579.309514:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788463579.309525:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788463579.309535:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788463579.309556:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788463579.309567:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788463579.310157:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788463579.310175:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788463579.310186:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788463579.310210:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788463579.310225:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788463579.310239:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788463579.310254:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788463579.310266:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788463579.310278:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788463579.310291:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788463579.310304:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788463579.310317:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788463579.310331:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788463579.310343:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788463579.310386:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788463579.310394:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788463579.310516:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463579.310608:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.310665:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485845888 00000100:00100000:0.0:1788463579.310673:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485845888 00000100:00100000:0.0:1788463579.310735:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463579.310755:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485845888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463579.310881:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485845888:12345-0@lo:501:mount.lustre.0 Request processed in 137us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463579.310889:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463579.310932:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463579.310958:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485845888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463579.314443:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463579.314546:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.314616:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.315121:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846016 00000100:00100000:3.0:1788463579.315130:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846016 00000100:00100000:3.0:1788463579.315183:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463579.315193:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463579.315320:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846016:12345-0@lo:503:mount.lustre.0 Request processed in 128us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.315328:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788463579.317946:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463579.318469:0:18557:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463579.318567:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.318682:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.318727:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.319146:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846144 00000100:00100000:3.0:1788463579.319153:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846144 00000100:00100000:3.0:1788463579.319209:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788463579.319220:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463579.319354:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846144:12345-0@lo:502:mount.lustre.0 Request processed in 135us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.319371:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463579.319882:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463579.321199:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788463579.321248:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788463579.321264:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788463579.321278:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788463579.321292:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788463579.321306:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788463579.321319:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788463579.321330:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788463579.321342:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788463579.321354:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788463579.321367:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788463579.321382:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788463579.321394:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788463579.321426:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788463579.321440:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788463579.321452:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788463579.321479:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788463579.321493:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788463579.321507:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788463579.321520:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788463579.321533:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788463579.321547:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788463579.321560:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788463579.321592:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788463579.321609:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788463579.321637:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788463579.321650:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788463579.321664:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788463579.321679:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788463579.321706:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788463579.321723:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788463579.321737:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788463579.321765:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788463579.321780:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788463579.321794:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788463579.321807:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788463579.321821:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788463579.321834:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788463579.321846:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788463579.321857:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788463579.321868:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788463579.321880:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788463579.321892:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788463579.321905:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788463579.321917:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788463579.321945:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788463579.321958:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788463579.321971:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788463579.324899:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.327986:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.328074:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.328863:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846272 00000100:00100000:3.0:1788463579.328874:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846272 00000100:00100000:3.0:1788463579.328929:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463579.328938:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463579.329102:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846272:12345-0@lo:502:mount.lustre.0 Request processed in 164us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.329111:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788463579.331157:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463579.331400:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788463579.331431:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788463579.331483:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463579.331560:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463579.331615:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.331687:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846400 00000100:00100000:3.0:1788463579.331695:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846400 00000100:00100000:3.0:1788463579.331757:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788463579.331767:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463579.331877:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485846400:12345-0@lo:502:mount.lustre.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.331884:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788463579.332134:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485846400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463579.332179:0:18557:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788463579.332188:0:18557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788463579.340859:0:18583:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788463579.340877:0:18583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff961787c9b380) 00000020:00000080:3.0:1788463579.340899:0:18583:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788463579.341020:0:18583:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188cf2e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463579.341024:0:18583:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188cf2e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463579.341026:0:18583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cf2e800 3 00010000:00080000:3.0:1788463579.341062:0:18583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9617873b8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463579.342714:0:18583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788463579.345801:0:18583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788463579.345880:0:18583:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463579.345898:0:18583:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x841acb7f42a3aac8 00000100:00080000:2.0:1788463579.345909:0:18583:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463579.345915:0:18583:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9617873b8000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:2.0:1788463579.345953:0:18583:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fa19500 x1875339485846528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463579.346014:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485846528:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463579.346086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463579.346148:0:18583:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788463579.346696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463579.346700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463579.346702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463579.346705:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463579.346729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463579.346732:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463579.346734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463579.346737:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463579.346837:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846528 00000100:00100000:2.0:1788463579.346846:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846528 00000100:00100000:2.0:1788463579.347109:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463579.347117:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485846528:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463579.347143:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:2.0:1788463579.347182:0:17058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x841acb7f42a3aacf 00000004:00100000:2.0:1788463579.347199:0:17058:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463579.347241:0:17058:0:(import.c:65:import_set_state_nolock()) ffff96178689e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463579.347311:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875339485846528:12345-0@lo:38:llog_process_th.0 Request processed in 192us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.347318:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788463579.348466:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188fa19500 x1875339485846528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463579.348480:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463579.348489:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788463579.348498:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788463579.348503:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788463579.348505:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9617873b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463579.348511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3647:1875339485846528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463579.348630:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485846656:0@lo:400:kworker.0 00000100:00100000:1.0:1788463579.348680:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.348713:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463579.348719:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485847040:0@lo:400:kworker.0 00000100:00100000:1.0:1788463579.348770:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.348806:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847040 00000100:00100000:1.0:1788463579.348811:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847040 00000100:00100000:1.0:1788463579.348850:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463579.348858:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485847040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463579.348901:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485847040:12345-0@lo:400:kworker.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.348907:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788463579.348932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188fa1b480 x1875339485847040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463579.348942:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485847040:0@lo:400:kworker.0 00000100:00100000:2.0:1788463579.349129:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846656 00000100:00100000:2.0:1788463579.349134:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846656 00000100:00100000:2.0:1788463579.349164:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463579.349172:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485846656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463579.349218:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485846656:12345-0@lo:400:kworker.0 Request processed in 47us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.349224:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463579.349869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485846656:0@lo:400:kworker.0 00000100:00100000:2.0:1788463579.349974:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485846912:0@lo:400:kworker.0 00000100:00100000:2.0:1788463579.350390:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.350425:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463579.350432:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485846784:0@lo:400:kworker.0 00000100:00100000:2.0:1788463579.350466:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.350664:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846784 00000100:00100000:1.0:1788463579.350671:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846784 00000100:00100000:1.0:1788463579.350713:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463579.350722:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485846784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463579.350850:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485846784:12345-0@lo:400:kworker.0 Request processed in 129us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.350857:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788463579.350890:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96188fa1a300 x1875339485846784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463579.350902:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485846784:0@lo:400:kworker.0 00000100:00100000:3.0:1788463579.351175:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485846912 00000100:00100000:3.0:1788463579.351181:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485846912 00000100:00100000:3.0:1788463579.351203:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463579.351211:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485846912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463579.351263:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485846912:12345-0@lo:400:kworker.0 Request processed in 53us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463579.351271:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463579.351297:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485846912:0@lo:400:kworker.0 00000020:01000004:2.0:1788463579.352968:0:18583:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788463579.352996:0:18583:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9617871e99c0) 00000020:00000080:2.0:1788463579.353026:0:18583:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788463579.353121:0:18583:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96188cf2e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463579.353126:0:18583:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96188cf2e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788463579.353129:0:18583:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96188cf2e800 3 00010000:00080000:2.0:1788463579.353157:0:18583:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96178689f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463579.360911:0:18583:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788463579.362285:0:18583:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788463579.362343:0:18583:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463579.362357:0:18583:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x841acb7f42a3aadd 00000100:00080000:3.0:1788463579.362368:0:18583:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463579.362375:0:18583:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff96178689f800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463579.362432:0:18583:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff961787e18e00 x1875339485847168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463579.362485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485847168:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788463579.367707:0:18583:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788463579.367753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463579.367759:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463579.367761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463579.367764:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463579.367768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463579.367771:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463579.367773:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463579.367776:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788463579.369026:0:18583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788463579.369171:0:18557:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788463579.369207:0:18557:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463579.369231:0:18557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463579.369252:0:18557:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1a00/0x841acb7f42a3aab3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaba expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463579.369305:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463579.369307:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463579.369308:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463579.369309:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463579.369310:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463579.369311:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463579.369313:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463579.369315:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463579.369316:0:18557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463579.369321:0:18557:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788463579.369323:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463579.369325:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463579.369326:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463579.369327:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463579.369328:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463579.369329:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463579.369330:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463579.369331:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463579.369332:0:18557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463579.369358:0:18557:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788463579.369377:0:18557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485847296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463579.369448:0:18557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.369504:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847296 00000100:00100000:1.0:1788463579.369511:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847296 00000100:00100000:1.0:1788463579.369560:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788463579.369570:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485847296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463579.369621:0:17050:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788463579.369636:0:17050:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788463579.369771:0:18557:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188cee16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463579.371721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463579.371952:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847168 00000100:00100000:1.0:1788463579.371975:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847168 00000100:00100000:1.0:1788463579.372034:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463579.372041:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875339485847168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788463579.372071:0:17057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:1.0:1788463579.372108:0:17057:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x841acb7f42a3aae4 00000004:00100000:1.0:1788463579.372123:0:17057:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463579.372157:0:17057:0:(import.c:65:import_set_state_nolock()) ffff9617873ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463579.372272:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875339485847168:12345-0@lo:38:llog_process_th.0 Request processed in 229us (9709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.372279:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:1.0:1788463579.379939:0:17050:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788463579.379956:0:17050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788463579.380336:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:18557:x1875339485847296:12345-0@lo:253:mount.lustre.0 Request processed in 10761us (10881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463579.380348:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463579.380443:0:18557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:18557:1875339485847296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463579.380466:0:18557:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788463579.380470:0:18557:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463579.380472:0:18557:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463579.380473:0:18557:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463579.380475:0:18557:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463579.380476:0:18557:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463579.380477:0:18557:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463579.380479:0:18557:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463579.380481:0:18557:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463579.380482:0:18557:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463579.380497:0:18557:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00080000:0.0:1788463579.382515:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff961787e18e00 x1875339485847168/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463579.382528:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463579.382539:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788463579.382547:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463579.382553:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788463579.382556:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178689f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463579.382562:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3647:1875339485847168:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788463579.382728:0:17072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788463579.382734:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788463579.382758:0:17072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.382775:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.382783:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 20 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.382790:0:17072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.382838:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 20 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.382853:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 20 pid: 17051 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463579.382866:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485847424:0@lo:104: 00000100:00100000:3.0:1788463579.382932:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463579.383023:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463579.383032:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463579.383041:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485847552:0@lo:104: 00000100:00100000:3.0:1788463579.383064:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463579.391831:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787095d80 going to sleep for 11 seconds 00000001:00000004:3.0:1788463579.395327:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788463579.395602:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847424 00000100:00100000:2.0:1788463579.395612:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847424 00000100:00100000:2.0:1788463579.395663:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847552 00000100:00100000:2.0:1788463579.395666:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847552 00000100:00100000:2.0:1788463579.395686:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463579.395698:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485847424:12345-0@lo:104: 00010000:00010000:2.0:1788463579.395721:0:18209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.395833:0:18209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463579.395840:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485847424:12345-0@lo:104: Request processed in 145us (12908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.395847:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463579.395865:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463579.395871:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188ff44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485847552:12345-0@lo:104: 00010000:00010000:2.0:1788463579.395888:0:18209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.395925:0:18209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463579.395930:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188ff44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485847552:12345-0@lo:104: Request processed in 59us (12865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.395935:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463579.396203:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e18e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485847424:0@lo:104: 00000100:00100000:2.0:1788463579.396214:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485847552:0@lo:104: 00010000:00010000:2.0:1788463579.396237:0:17072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396254:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463579.396260:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396266:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463579.396271:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396280:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463579.396286:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463579.396291:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463579.396326:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396343:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463579.396364:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396370:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961787d0c200/0x841acb7f42a3aa3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa43 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396382:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463579.396385:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396390:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde600 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:2.0:1788463579.396393:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396399:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463579.396405:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463579.396410:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463579.396422:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396428:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463579.396444:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396451:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bde600/0x841acb7f42a3aa2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa35 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396482:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463579.396484:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463579.396485:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463579.396491:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463579.396506:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463579.396522:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485847680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463579.396563:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.396622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485847808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463579.396663:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463579.396700:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847680 00000100:00100000:2.0:1788463579.396704:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847680 00010000:00010000:2.0:1788463579.396722:0:17043:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 21 pid: 17051 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463579.396755:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847808 00000100:00100000:2.0:1788463579.396758:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847808 00010000:00010000:2.0:1788463579.396771:0:17043:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 22 pid: 17050 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463579.396785:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463579.396791:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+22:3648:x1875339485847680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463579.396803:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463579.396808:0:17043:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 22 pid: 17051 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396818:0:17043:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 22 pid: 17051 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396843:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0d600/0x841acb7f42a3aa43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aa3c expref: 22 pid: 17051 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396856:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463579.396886:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+21:3648:x1875339485847680:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.396893:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463579.396908:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463579.396913:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+20:3650:x1875339485847808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463579.396921:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463579.396926:0:17043:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396934:0:17043:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396944:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0cc00/0x841acb7f42a3aa35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aa2e expref: 20 pid: 17050 timeout: 718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396956:0:17043:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.396965:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463579.397046:0:17043:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014312457s 00010000:00010000:2.0:1788463579.397052:0:17043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397070:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397077:0:17043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397084:0:17043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397089:0:17043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463579.397094:0:17043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397103:0:17043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397116:0:17043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397126:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463579.397155:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+19:3650:x1875339485847808:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463579.397162:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788463579.397209:0:17072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397218:0:17072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463579.397224:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961786bdf200/0x841acb7f42a3aaeb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463579.397262:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485847808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463579.397283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485847680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463579.398166:0:17040:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00002000:00080000:1.0:1788463579.400401:0:18557:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788463579.400413:0:18557:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788463579.400464:0:18557:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788463579.400514:0:18557:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788463579.400555:0:18557:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788463579.400769:0:18557:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788463579.403766:0:18557:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463579.404078:0:18557:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463579.781005:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463580.533797:0:18636:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463580.534008:0:18636:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463580.803821:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463581.062620:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463581.062627:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188cec8000 from 9 10000000:01000000:3.0:1788463581.062632:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463581.062680:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463581.062714:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463581.062727:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463581.062769:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485847936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463581.062841:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463581.062887:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463581.064286:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485847936 00000100:00100000:2.0:1788463581.064302:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485847936 00000100:00100000:2.0:1788463581.064352:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463581.064362:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+19:17054:x1875339485847936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463581.064381:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463581.064398:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aaf2 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.064437:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 20 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.064448:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 20 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.064459:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26e00, rc 0) 00000100:00100000:2.0:1788463581.064529:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:17054:x1875339485847936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463581.064538:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788463581.065667:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485847936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463581.067150:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463581.067170:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463581.067269:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463581.067672:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463581.067857:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c06240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463581.071627:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848064 00000100:00100000:2.0:1788463581.071640:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848064 00000100:00100000:2.0:1788463581.071698:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463581.071723:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:17054:x1875339485848064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788463581.071750:0:17050:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788463581.071764:0:17050:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788463581.071767:0:17050:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788463581.071913:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+20:17054:x1875339485848064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 198us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463581.071921:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463581.071975:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788463581.072042:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463581.072053:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.072063:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463581.072072:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788463581.072075:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96189154b000 from 9 10000000:01000000:2.0:1788463581.072077:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463581.072108:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.072115:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.072123:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463581.072143:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463581.072184:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463581.072215:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d2776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463581.075176:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848192 00000100:00100000:0.0:1788463581.075193:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848192 00000100:00100000:0.0:1788463581.075253:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788463581.075264:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+20:17054:x1875339485848192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463581.075282:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463581.075311:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ab00 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463581.075339:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 21 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463581.075350:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 21 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463581.075359:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1200, rc 0) 00000100:00100000:0.0:1788463581.075524:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485848192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (3338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463581.075530:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788463581.076522:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463581.076545:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463581.076554:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463581.076659:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788463581.076728:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463581.076762:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463581.076780:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848320 00000100:00100000:1.0:1788463581.076800:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848320 00000100:00100000:1.0:1788463581.076836:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788463581.076845:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485848320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463581.076860:0:17051:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463581.076876:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463581.076893:0:17051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788463581.076971:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485848320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463581.076980:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788463581.077085:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485848320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463581.077141:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463581.077148:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463581.077156:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463581.830651:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463582.854035:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463583.107803:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485848448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463583.107816:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463583.107832:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485848576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463583.107881:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463583.107947:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848448 00000100:00100000:2.0:1788463583.107965:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848448 00000100:00100000:3.0:1788463583.107972:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463583.108037:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848576 00000100:00100000:0.0:1788463583.108042:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848576 00000100:00100000:0.0:1788463583.108079:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463583.108089:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485848448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463583.108125:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788463583.108188:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485848448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463583.108196:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463583.108213:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463583.108219:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485848576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463583.108248:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463583.108283:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485848576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463583.108289:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463583.108328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485848576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463583.108541:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485848448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788463583.877201:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463584.197162:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788463584.646277:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463584.646287:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463584.646290:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463584.646293:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463584.646323:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463584.646326:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463584.646330:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463584.646333:0:1365:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788463584.646415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485848832:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.646521:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463584.646610:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485849344:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.646646:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463584.646674:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788463584.646679:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485848960:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.646701:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463584.646717:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485849472:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.646738:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463584.646776:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848832 00000100:00100000:1.0:1788463584.646785:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848832 00000100:00100000:1.0:1788463584.646842:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463584.646853:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485848832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.646918:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485848832:12345-0@lo:400:kworker.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463584.646926:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463584.646954:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849344 00000100:00100000:1.0:1788463584.646958:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849344 00000100:00100000:1.0:1788463584.646991:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848960 00000100:00100000:1.0:1788463584.646994:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848960 00000100:00100000:1.0:1788463584.647007:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849472 00000100:00100000:1.0:1788463584.647033:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849472 00000100:00100000:1.0:1788463584.647055:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463584.647061:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485849344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.647093:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485849344:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463584.647100:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463584.647113:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463584.647119:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485848960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.647145:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485848960:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463584.647151:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463584.647162:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463584.647167:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485849472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.647191:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485849472:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463584.647196:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788463584.647246:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c0e00 x1875339485848960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463584.647264:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485848960:0@lo:400:kworker.0 00010000:00080000:1.0:1788463584.647276:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c0380 x1875339485849472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463584.647284:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485849472:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.647294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485848832:0@lo:400:kworker.0 00010000:00080000:1.0:1788463584.647303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c2d80 x1875339485849344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463584.647318:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485849344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.647791:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485848704:0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.647858:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463584.647901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485849216:0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.647928:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463584.647951:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463584.647958:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485849088:0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.647995:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463584.648038:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849216 00000100:00100000:3.0:1788463584.648044:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849216 00000100:00100000:3.0:1788463584.648086:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463584.648094:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485849216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.648134:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485849216:12345-0@lo:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463584.648141:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788463584.648177:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463584.648182:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788463584.648205:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188d1c0700 x1875339485849216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463584.648216:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485849216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463584.649625:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485848704 00000100:00100000:1.0:1788463584.649642:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485848704 00000100:00100000:1.0:1788463584.649729:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788463584.649740:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3649:x1875339485848704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463584.650184:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849088 00000100:00100000:0.0:1788463584.650190:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849088 00000100:00100000:0.0:1788463584.650225:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463584.650233:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485849088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463584.650298:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485849088:12345-0@lo:400:kworker.0 Request processed in 66us (2303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463584.650307:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788463584.651567:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3649:x1875339485848704:12345-0@lo:400:kworker.0 Request processed in 82us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463584.651597:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463584.655519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485849088:0@lo:400:kworker.0 00000100:00100000:3.0:1788463584.655542:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485848704:0@lo:400:kworker.0 00010000:00010000:0.0:1788463584.904324:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463585.924118:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463586.949318:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463587.376543:0:18926:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788463587.587807:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463572/real 1788463572] req@ffff961787e1a680 x1875339485842944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.587848:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e1a680 x1875339485842944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.587860:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463572/real 1788463572] req@ffff961787e1ad80 x1875339485843072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.587872:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e1ad80 x1875339485843072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463587.587897:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463587.587927:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788463587.587932:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485842944:0@lo:8:kworker.0 00000100:00080000:3.0:1788463587.587956:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463587.587963:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788463587.587966:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485843072:0@lo:8:kworker.0 00000100:00080000:0.0:1788463587.588307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463587.588314:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463587.588318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463587.588321:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463587.588364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463587.588369:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788463587.588372:0:8:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463587.588379:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788463587.588386:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788463587.588393:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff961883731000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463587.588427:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf31f80 x1875339485850112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463587.588439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463587.588443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463587.588445:0:8:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463587.588448:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 612 00000100:00080000:0.0:1788463587.588451:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788463587.588454:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463587.588464:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf30a80 x1875339485850240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463587.588519:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485849856:0@lo:400:kworker.0 00000100:00100000:0.0:1788463587.588665:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463587.588706:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485850624:0@lo:400:kworker.0 00000100:00100000:0.0:1788463587.588742:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463587.588768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463587.588904:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485849984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463587.588938:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463587.588989:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849984 00000100:00100000:0.0:1788463587.589164:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849984 00000100:00100000:0.0:1788463587.589241:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463587.589256:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485849984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463587.589351:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485849984:12345-0@lo:400:kworker.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463587.589361:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463587.589421:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485849984:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.589645:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485850112:0@lo:8:kworker.0 00000100:00100000:3.0:1788463587.589687:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.589727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485850240:0@lo:8:kworker.0 00000100:00100000:3.0:1788463587.590117:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.590164:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485849728:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.590195:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.590218:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485850496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.590333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.590357:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788463587.590364:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485849600:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.590394:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.590410:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485850368:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.590430:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463587.590453:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849856 00000100:00100000:3.0:1788463587.590460:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849856 00000100:00100000:3.0:1788463587.590494:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850624 00000100:00100000:3.0:1788463587.590498:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850624 00000100:00100000:3.0:1788463587.590523:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850496 00000100:00100000:3.0:1788463587.590526:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850496 00000100:00100000:3.0:1788463587.590539:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850368 00000100:00100000:3.0:1788463587.590542:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850368 00000100:00100000:3.0:1788463587.590554:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463587.590563:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485849856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463587.595361:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850112 00000100:00100000:0.0:1788463587.595386:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850112 00000100:00100000:0.0:1788463587.595478:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850240 00000100:00100000:0.0:1788463587.595482:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850240 00000100:00100000:0.0:1788463587.595504:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463587.595515:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485850112:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463587.595566:0:18562:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:0.0:1788463587.595633:0:18562:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3ab0e 00002000:00100000:0.0:1788463587.595653:0:18562:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff961786a7e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788463587.595658:0:18562:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788463587.595662:0:18562:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788463587.596211:0:17057:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788463587.596224:0:17057:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788463587.596265:0:17058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788463587.596277:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463587.596291:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485850624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.596424:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485850624:12345-0@lo:400:kworker.0 Request processed in 139us (7692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463587.596433:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463587.596457:0:17058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788463587.596465:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463587.596472:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485850496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.596511:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485850496:12345-0@lo:400:kworker.0 Request processed in 39us (6178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463587.596517:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463587.596526:0:17058:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788463587.596531:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463587.596538:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485850368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.596563:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875339485850368:12345-0@lo:400:kworker.0 Request processed in 26us (6132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463587.596569:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788463587.597168:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf31500 x1875339485850624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463587.597188:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485850624:0@lo:400:kworker.0 00000100:00080000:1.0:1788463587.598017:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463587.598027:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463587.598047:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849600 00000100:00100000:1.0:1788463587.598057:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849600 00000100:00100000:1.0:1788463587.598118:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463587.598128:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:3649:x1875339485849600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463587.598215:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:3649:x1875339485849600:12345-0@lo:400:kworker.0 Request processed in 89us (7819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463587.598222:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00002000:00080000:0.0:1788463587.598472:0:18562:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788463587.598516:0:18562:0:(import.c:65:import_set_state_nolock()) ffff961786a7a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463587.599016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485849600:0@lo:400:kworker.0 00010000:00080000:3.0:1788463587.599043:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf30000 x1875339485850368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.599058:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875339485850368:0@lo:400:kworker.0 00010000:00080000:3.0:1788463587.599074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf32300 x1875339485850496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.599104:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485850496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.599225:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485849856:12345-0@lo:400:kworker.0 Request processed in 8662us (10561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463587.599462:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485850112:12345-0@lo:8:kworker.0 Request processed in 3060us (8886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463587.599477:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463587.599506:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463587.599515:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485850240:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788463587.599541:0:18562:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788463587.600851:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788463587.600983:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf31c00 x1875339485849856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.602403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485849856:0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.602471:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485849728 00000100:00100000:3.0:1788463587.602481:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485849728 00000100:00100000:3.0:1788463587.602554:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463587.602564:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485849728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463587.606236:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485849728:12345-0@lo:400:kworker.0 Request processed in 3654us (16020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463587.606258:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788463587.607158:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188cf31f80 x1875339485850112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463587.607175:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463587.607205:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788463587.607217:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788463587.607225:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788463587.607230:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961883731000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788463587.607259:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788463587.607267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485850112:0@lo:8:kworker.0 00000004:00080000:1.0:1788463587.607371:0:17798:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788463587.607397:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485850880:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788463587.607473:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463587.607507:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463587.607532:0:18564:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788463587.607543:0:18564:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788463587.607701:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463587.607716:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485850752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463587.607746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463587.607793:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850880 00000100:00100000:1.0:1788463587.607800:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850880 00000100:00080000:1.0:1788463587.607856:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463587.607949:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463587.607960:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17798:x1875339485850880:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788463587.608275:0:17797:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788463587.608398:0:17797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 627059822238ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788463587.608405:0:17797:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788463587.612305:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485850752 00000100:00100000:3.0:1788463587.612331:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485850752 00000100:00100000:3.0:1788463587.612410:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463587.612422:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875339485850752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463587.612466:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463587.612606:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875339485850752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (4858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463587.612614:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788463587.612791:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727d880 x1875339485850752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463587.612843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485850752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463587.619064:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485849728:0@lo:400:kworker.0 00000004:00080000:3.0:1788463587.638322:0:17789:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788463587.644664:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3647:x1875339485850240:12345-0@lo:8:kworker.0 Request processed in 45135us (54533us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463587.644683:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788463587.645720:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463587.645730:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788463587.645735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485850240:0@lo:8:kworker.0 00002000:00080000:0.0:1788463587.672087:0:18933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788463587.672104:0:18933:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788463587.672249:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17798:x1875339485850880:12345-0@lo:7:osp-pre-0-1.0 Request processed in 64283us (64768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463587.672261:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788463587.672453:0:17798:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727fb80 x1875339485850880/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463603 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463587.672472:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485850880:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788463587.672491:0:17798:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788463587.672560:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485851008:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788463587.672638:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463587.672672:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463587.672894:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851008 00000100:00100000:0.0:1788463587.672903:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851008 00000100:00100000:0.0:1788463587.672959:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463587.672969:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17798:x1875339485851008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788463587.673001:0:18564:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788463587.673041:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17798:x1875339485851008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 73us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463587.673047:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463587.673173:0:17798:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727fb80 x1875339485851008/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463603 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463587.673184:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485851008:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788463587.673194:0:17798:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788463587.673222:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485851136:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788463587.673256:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463587.673278:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff961898b5a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463587.673342:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851136 00000100:00100000:3.0:1788463587.673347:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851136 00000100:00100000:3.0:1788463587.673378:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463587.673385:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17798:x1875339485851136:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788463587.673420:0:18562:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1788463587.766524:0:18558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788463587.766547:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788463587.766841:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17798:x1875339485851136:12345-0@lo:5:osp-pre-0-1.0 Request processed in 93446us (93574us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788463587.766858:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788463587.767159:0:17798:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727fb80 x1875339485851136/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463603 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463587.767173:0:17798:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788463587.767180:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17798:1875339485851136:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788463587.767201:0:17798:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788463587.767281:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17798:1875339485851264:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788463587.767344:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463587.767388:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618853f7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463587.771923:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851264 00000100:00100000:2.0:1788463587.771946:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851264 00000100:00100000:2.0:1788463587.772028:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463587.772039:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17798:x1875339485851264:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788463587.772176:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17798:x1875339485851264:12345-0@lo:900:osp-pre-0-1.0 Request processed in 139us (4831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463587.772184:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788463587.772258:0:17798:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d4380 x1875339485851264/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463603 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463587.772276:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17798:1875339485851264:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788463587.980952:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463588.228517:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485851392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463588.229213:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463588.230480:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851392 00000100:00100000:2.0:1788463588.230495:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851392 00000100:00100000:2.0:1788463588.230561:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463588.230589:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485851392:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463588.230894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485851520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463588.230972:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463588.231020:0:17061:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788463588.231031:0:17061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788463588.231162:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851520 00000100:00100000:3.0:1788463588.231167:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851520 00000004:00000024:2.0:1788463588.231560:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788463588.232031:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485851392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1457us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463588.232042:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463588.232068:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463588.232077:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485851520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463588.232106:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463588.232141:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485851520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463588.232147:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788463588.232196:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485851520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463588.232883:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485851392:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788463588.732662:0:18982:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463588.736050:0:18982:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788463589.004909:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463589.380353:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788463589.913985:0:19032:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788463589.914225:0:19032:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788463590.027244:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463591.043764:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.069051:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463592.717341:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463572/real 1788463572] req@ffff961787e1b480 x1875339485842432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463592.717369:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e1b480 x1875339485842432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463592.717386:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463572/real 1788463572] req@ffff961787e19500 x1875339485842560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463592.717397:0:3647:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff961787e19500 x1875339485842560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463592.717416:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463592.717462:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463592.717466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485842432:0@lo:8:kworker.0 00000100:00080000:0.0:1788463592.717472:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463592.717892:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463592.717897:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788463592.717900:0:1365:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463592.717905:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788463592.717910:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788463592.717915:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96188ced9800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463592.717933:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178727ed80 x1875339485851904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463592.717942:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463592.717944:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463592.717946:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463592.717949:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788463592.717958:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788463592.717962:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463592.717972:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178727c000 x1875339485852032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463592.718005:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463592.718008:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463592.718010:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463592.718013:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 627 00000100:00080000:1.0:1788463592.718015:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788463592.718018:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:1.0:1788463592.718027:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96178727f100 x1875339485852544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463592.718066:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485851776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718122:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718164:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485852672:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718183:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718213:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788463592.718218:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485851648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718240:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718258:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485852416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718275:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718295:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485852160:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718326:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485852800:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718349:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718362:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463592.718366:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485852288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718394:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485852928:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.718408:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.718431:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852416 00000100:00100000:1.0:1788463592.718438:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852416 00000100:00100000:1.0:1788463592.718482:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463592.718503:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485852416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.719274:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485852416:12345-0@lo:400:kworker.0 Request processed in 768us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463592.719283:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463592.719309:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851776 00000100:00100000:1.0:1788463592.719313:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851776 00000100:00100000:1.0:1788463592.719336:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852288 00000100:00100000:1.0:1788463592.719338:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852288 00000100:00100000:1.0:1788463592.719348:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463592.719354:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485851776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.719390:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485851776:12345-0@lo:400:kworker.0 Request processed in 36us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463592.719395:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463592.719404:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788463592.719409:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485852288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.719433:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485852288:12345-0@lo:400:kworker.0 Request processed in 24us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463592.719439:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788463592.719459:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463592.719486:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727d180 x1875339485852416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463592.719499:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485852416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.719509:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485851776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463592.719533:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485852288:0@lo:400:kworker.0 00000100:00080000:0.0:1788463592.719930:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463592.719936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485842560:0@lo:8:kworker.0 00000100:00100000:0.0:1788463592.719959:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485851904:0@lo:8:kworker.0 00000100:00100000:0.0:1788463592.720003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463592.720034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485852032:0@lo:8:kworker.0 00000100:00100000:0.0:1788463592.720059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463592.720077:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485852544:0@lo:8:kworker.0 00000100:00100000:0.0:1788463592.720095:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463592.720133:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851904 00000100:00100000:0.0:1788463592.720139:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851904 00000100:00100000:0.0:1788463592.720155:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852032 00000100:00100000:0.0:1788463592.720158:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852032 00000100:00100000:0.0:1788463592.720164:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852544 00000100:00100000:0.0:1788463592.720166:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852544 00000100:00100000:0.0:1788463592.720175:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463592.720180:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485851904:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463592.720233:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:0.0:1788463592.720261:0:18933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3ab15 00002000:00100000:0.0:1788463592.720274:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff961786a78000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788463592.720278:0:18933:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788463592.720281:0:18933:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788463592.720357:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788463592.720384:0:18933:0:(import.c:65:import_set_state_nolock()) ffff961786a79800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463592.720427:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485851904:12345-0@lo:8:kworker.0 Request processed in 246us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463592.720434:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463592.720451:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463592.720455:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485852032:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788463592.720466:0:18933:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463592.721702:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463592.721710:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485852544:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788463592.721730:0:18564:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788463592.721791:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485852544:12345-0@lo:8:kworker.0 Request processed in 79us (1694us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463592.721797:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463592.723751:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852672 00000100:00100000:3.0:1788463592.723764:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852672 00000100:00100000:3.0:1788463592.723808:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852160 00000100:00100000:3.0:1788463592.723812:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852160 00000100:00100000:3.0:1788463592.723823:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852800 00000100:00100000:3.0:1788463592.723826:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852800 00000100:00100000:3.0:1788463592.723855:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485852928 00000100:00100000:3.0:1788463592.723858:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485852928 00000100:00100000:3.0:1788463592.723876:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463592.723885:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485852672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463592.723976:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485852672:12345-0@lo:400:kworker.0 Request processed in 92us (5791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.723997:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463592.724013:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463592.724019:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485852160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463592.724053:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485852160:12345-0@lo:400:kworker.0 Request processed in 34us (5739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.724059:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463592.724069:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788463592.724074:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485852800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463592.724101:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485852800:12345-0@lo:400:kworker.0 Request processed in 27us (5751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.724107:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788463592.724117:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463592.724123:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485852928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463592.724147:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485852928:12345-0@lo:400:kworker.0 Request processed in 25us (5738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.724153:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463592.724173:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485851648 00000100:00100000:3.0:1788463592.724177:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485851648 00000100:00100000:3.0:1788463592.724215:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463592.724221:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:3651:x1875339485851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463592.724251:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:3651:x1875339485851648:12345-0@lo:400:kworker.0 Request processed in 30us (6009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.724257:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463592.724320:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485851648:0@lo:400:kworker.0 00010000:00080000:3.0:1788463592.724346:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727ea00 x1875339485852672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463592.724359:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485852672:0@lo:400:kworker.0 00010000:00080000:3.0:1788463592.724396:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727d880 x1875339485852928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463592.724406:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485852928:0@lo:400:kworker.0 00010000:00080000:3.0:1788463592.724417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727ca80 x1875339485852160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463592.724425:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485852160:0@lo:400:kworker.0 00010000:00080000:3.0:1788463592.724436:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727fb80 x1875339485852800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463592.724444:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485852800:0@lo:400:kworker.0 00000100:00080000:1.0:1788463592.724706:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463592.724712:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788463592.725746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96178727ed80 x1875339485851904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463592.725758:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788463592.725768:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788463592.725778:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788463592.725784:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788463592.725787:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96188ced9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788463592.725817:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788463592.725824:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485851904:0@lo:8:kworker.0 00000100:00080000:1.0:1788463592.725846:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463592.725851:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788463592.725865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485852544:0@lo:8:kworker.0 00000004:00080000:3.0:1788463592.725989:0:17080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788463592.726085:0:17080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 632177509815ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788463592.726092:0:17080:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788463592.728295:0:17036:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788463592.739729:0:17081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788463592.739759:0:17081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17081:1875339485853184:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788463592.739824:0:17081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463592.739862:0:17081:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618902dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463592.739884:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485853056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463592.739909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463592.739948:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853056 00000100:00100000:3.0:1788463592.739955:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853056 00000100:00100000:3.0:1788463592.740027:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463592.740036:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485853056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463592.740065:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463592.740108:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485853056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463592.740115:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788463592.740138:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463592.740166:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fbee300 x1875339485853056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463592.740184:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485853056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463592.741262:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853184 00000100:00100000:1.0:1788463592.741273:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853184 00000100:00100000:1.0:1788463592.741318:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463592.741326:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17081:x1875339485853184:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463592.748524:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485852032:12345-0@lo:8:kworker.0 Request processed in 28059us (28455us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463592.748551:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788463592.749126:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788463592.749133:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788463592.749137:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485852032:0@lo:8:kworker.0 00002000:00080000:3.0:1788463592.750358:0:18564:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788463592.750367:0:18564:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788463592.750372:0:18564:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1788463592.769899:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.769912:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.769928:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.769933:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.769940:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.769970:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.769980:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.769989:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.770010:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463592.770987:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463592.770996:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.771007:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463592.771012:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.771023:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.771053:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.771061:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.771083:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.771086:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.771087:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463592.772429:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.772440:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.772455:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.772461:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.772468:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.772481:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.772490:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.772511:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.772530:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463592.772849:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463592.772856:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.772864:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463592.772868:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.772876:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.772890:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.772898:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.772929:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.772931:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.772933:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463592.777681:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.777697:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.777716:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.777721:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.777728:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.777743:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.777752:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.777758:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.777778:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788463592.780855:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.780868:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.780892:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.780897:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.780903:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.780917:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.780928:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.780936:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.780956:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463592.781786:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463592.781795:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781817:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463592.781823:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781833:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781851:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781859:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f2a92c7/0x841acb7f42a3ab2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781883:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463592.781886:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781893:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463592.781905:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781913:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781924:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781930:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b6e2231/0x841acb7f42a3ab31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.781945:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.781947:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.781949:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.782954:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463592.789438:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.789452:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.789470:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.789475:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.789483:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.789497:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.789507:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.789528:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.789548:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463592.791168:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.791180:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791204:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.791210:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791221:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791254:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791263:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086800d02/0x841acb7f42a3ab38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791286:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.791288:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.791290:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463592.791959:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.791967:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.791979:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.791983:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.791989:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792002:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792010:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792017:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792049:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463592.792262:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463592.792268:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.792275:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463592.792279:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.792287:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.792302:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.792310:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d83b557a/0x841acb7f42a3ab3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.792338:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.792340:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.792341:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463592.792643:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.792649:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792794:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.792797:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.792801:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792810:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792819:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792825:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.792843:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463592.793044:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463592.793050:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.793058:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463592.793062:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.793070:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.793082:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.793090:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033daa1f/0x841acb7f42a3ab46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.793105:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.793107:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.793108:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463592.793252:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.793258:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.793266:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.793275:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.793280:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.793289:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.793298:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.793305:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.793356:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788463592.795971:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463592.795986:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.796005:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=632s v=(0 0) 00010000:00010000:2.0:1788463592.796010:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463592.796018:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.796032:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.796042:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.796057:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798641:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463592.798664:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798678:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463592.798683:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798694:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798714:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798723:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fc576e4/0x841acb7f42a3ab4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798742:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463592.798746:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798751:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463592.798763:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798771:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798781:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.798789:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.798791:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.798793:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.799072:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788463592.799081:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b94d6b/0x841acb7f42a3ab54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.799819:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463592.802722:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.802736:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.802755:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.802760:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.802767:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.802783:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.802794:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.802816:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.802843:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463592.803342:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463592.803350:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.803359:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdec00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463592.803364:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.803374:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.803391:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.803399:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bed3daa/0x841acb7f42a3ab5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.803427:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.803428:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.803430:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463592.806720:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.806733:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.806750:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.806755:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.806762:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.806777:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.806786:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.806793:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.806824:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463592.806841:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.806848:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.806855:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.806860:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.806870:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.806885:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.806892:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3ab62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.806910:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.806925:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.806926:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463592.807442:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.807449:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.807464:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.807468:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.807472:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.807492:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.807502:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.807510:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.807532:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463592.807767:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.807773:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.807781:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.807785:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.807793:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.807805:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.807812:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad8916b1/0x841acb7f42a3ab69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.807827:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.807828:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.807830:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463592.808797:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.808806:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.808819:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.808824:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.808830:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.808841:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.808865:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.808873:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.808924:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463592.809680:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.809688:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.809700:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.809704:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.809709:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.809719:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.809728:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.809735:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.809967:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463592.809975:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.809983:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.809987:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810004:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810019:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810026:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1c3cf82/0x841acb7f42a3ab70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810046:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.810049:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810055:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.810058:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810066:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810075:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.810082:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.810084:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.810092:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.812287:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788463592.812301:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5867f1/0x841acb7f42a3ab77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.812603:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463592.813067:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.813075:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813090:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.813095:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.813102:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813116:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813126:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813133:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813150:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463592.813474:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.813480:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813511:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.813514:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.813519:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813527:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813535:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813543:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.813558:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788463592.814361:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463592.814368:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.814379:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=632s v=(0 0) 00010000:00010000:3.0:1788463592.814383:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463592.814388:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.814396:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.814416:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.814423:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.814432:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788463592.814853:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788463592.814861:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814870:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.814875:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814885:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814903:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814910:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039828a0b/0x841acb7f42a3ab7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814931:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463592.814934:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814940:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.814943:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814964:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814975:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814982:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d073cd17/0x841acb7f42a3ab85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.814995:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.814998:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815005:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.815008:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815015:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815024:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815031:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065dee744/0x841acb7f42a3ab8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815053:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.815055:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.815057:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.815064:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463592.815367:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463592.815374:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.815383:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=632s v=(0 0) 00010000:00010000:1.0:1788463592.815386:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463592.815391:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.815401:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.815408:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.815416:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.815434:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463592.815850:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.815855:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815863:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.815867:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815877:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815889:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815896:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091f281fa/0x841acb7f42a3ab93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.815909:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.815910:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.815912:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463592.816013:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463592.816018:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816036:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=632s v=(0 0) 00010000:00010000:1.0:1788463592.816040:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463592.816044:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816053:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816060:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816067:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816086:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463592.816323:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.816329:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.816342:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0da00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.816345:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.816352:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.816362:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.816369:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b28f4a/0x841acb7f42a3ab9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.816381:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.816383:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.816384:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463592.816462:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463592.816468:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816475:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=632s v=(0 0) 00010000:00010000:1.0:1788463592.816479:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463592.816492:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816501:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816519:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816526:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.816594:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463592.816994:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463592.816999:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.817008:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=632s v=(0 0) 00010000:00010000:1.0:1788463592.817012:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463592.817016:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.817025:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.817033:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463592.817042:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.822771:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463592.822788:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.822802:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.822807:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.822819:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.822864:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.822873:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007096225a/0x841acb7f42a3aba1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.823090:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463592.823097:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.823116:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463592.823120:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.823129:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.823140:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.823149:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.823151:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.823153:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463592.824296:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463592.824311:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc800c82/0x841acb7f42a3aba8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.825019:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463592.825170:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.825187:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.825212:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.825217:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.825223:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.825236:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.825246:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.825253:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.825272:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463592.826273:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.826284:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.826295:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.826299:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.826304:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.826316:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.826332:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.826340:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.826361:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463592.826851:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463592.826866:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826875:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463592.826880:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826890:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826906:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826913:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbab4d5/0x841acb7f42a3abaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826930:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463592.826933:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826939:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463592.826943:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826950:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826970:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826977:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8bfd34b/0x841acb7f42a3abb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.826990:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.826992:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.826994:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.827052:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463592.827788:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.827796:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.827808:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.827812:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.827818:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.827830:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.827839:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.827847:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.827877:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463592.828310:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.828317:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.828325:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.828329:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.828333:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.828341:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.828348:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.828354:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.828464:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788463592.831115:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.831130:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.831148:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.831165:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.831171:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.831185:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.831206:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.831213:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833270:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788463592.833284:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833297:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.833303:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833314:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833338:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833345:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0a79512/0x841acb7f42a3abbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833389:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463592.833393:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833399:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.833401:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833408:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833418:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833424:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee39492/0x841acb7f42a3abc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833434:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463592.833437:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833442:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463592.833445:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833463:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833474:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.833493:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.833495:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463592.833497:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463592.834417:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.835997:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463592.836010:0:18564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000287c84ce/0x841acb7f42a3abcb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463592.836467:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463592.837203:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463592.837223:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485853312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463592.837292:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463592.837387:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853312 00000100:00100000:2.0:1788463592.837395:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853312 00000100:00100000:2.0:1788463592.837444:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463592.837453:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485853312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463592.837476:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788463592.837649:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485853312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 196us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463592.837786:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485853312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463592.837838:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1788463592.838025:0:18564:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463592.838037:0:18564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.838056:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=632s v=(0 0) 00010000:00010000:0.0:1788463592.838061:0:18564:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463592.838070:0:18564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.838087:0:18564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.838109:0:18564:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.838117:0:18564:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.838171:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788463592.838257:0:18564:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1788463592.838322:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17081:x1875339485853184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96996us (98497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463592.838330:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463592.838504:0:17081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17081:1875339485853184:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788463592.838520:0:17081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788463592.838558:0:17081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17081:1875339485853440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788463592.838618:0:17081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463592.838641:0:17081:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618bf56c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463592.838905:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853440 00000100:00100000:2.0:1788463592.838912:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853440 00000100:00100000:2.0:1788463592.838951:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463592.838959:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17081:x1875339485853440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788463592.838991:0:18563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788463592.842074:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463592.842086:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.842098:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463592.842104:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.842115:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.842136:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463592.842144:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050ae9139/0x841acb7f42a3abd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463592.846448:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.846455:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463592.846458:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788463592.847173:0:18558:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788463592.847230:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788463592.847477:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17081:x1875339485853440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8515us (8854us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788463592.847622:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463592.847907:0:17081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788463592.847916:0:17081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17081:1875339485853440:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788463592.847931:0:17081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1788463593.091783:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463593.348109:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463593.348133:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485853568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463593.348221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463593.348284:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853568 00000100:00100000:2.0:1788463593.348292:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853568 00000100:00100000:2.0:1788463593.348357:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463593.348369:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485853568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788463593.348406:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463593.348473:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485853568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463593.348481:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788463593.348503:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485853568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463593.349367:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463593.354257:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485853696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463593.354328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463593.354449:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853696 00000100:00100000:2.0:1788463593.354458:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853696 00000100:00100000:2.0:1788463593.354509:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463593.354518:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485853696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463593.354552:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788463593.354627:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485853696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463593.354634:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463593.355718:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485853696:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788463594.118064:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463594.437351:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788463595.139955:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463596.163892:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463597.187805:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788463597.715773:0:19377:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463597.715777:0:19377:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788463597.715779:0:19377:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788463597.715922:0:19377:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9617873bb000 00000020:01000004:3.0:1788463597.715941:0:19377:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788463597.715957:0:19377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788463597.715982:0:19377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff961788788000) 00000020:00000080:3.0:1788463597.715999:0:19377:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788463597.828365:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788463597.835488:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788463597.836261:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788463597.837527:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788463597.838023:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788463597.841222:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788463597.842121:0:19377:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1788463597.844109:0:19377:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788463597.844338:0:19377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788463597.844355:0:19377:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788463597.844369:0:19377:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a3abe0 00000020:01000004:1.0:1788463597.844376:0:19377:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788463597.844414:0:19377:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788463597.844418:0:19377:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788463597.844424:0:19377:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788463597.844455:0:19377:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788463597.844460:0:19377:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788463597.881505:0:19377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463597.881549:0:19377:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.153@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788463597.881555:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463597.881556:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463597.881558:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463597.881559:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463597.881561:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463597.881562:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463597.881563:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463597.881598:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463597.881600:0:19377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463597.881603:0:19377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788463597.881611:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463597.881613:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463597.881614:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463597.881615:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463597.881616:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463597.881617:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463597.881618:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463597.881619:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463597.881620:0:19377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463597.881647:0:19377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788463597.881669:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485853824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463597.881754:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.881811:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463597.881951:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853824 00000100:00100000:1.0:1788463597.881959:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853824 00000100:00100000:1.0:1788463597.882011:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788463597.882020:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:19377:x1875339485853824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463597.882059:0:17050:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788463597.882062:0:17050:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788463597.882066:0:17050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788463597.882455:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:19377:x1875339485853824:12345-0@lo:253:mount.lustre.0 Request processed in 435us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.882464:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788463597.882723:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485853824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463597.882734:0:19377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788463597.882737:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463597.882738:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463597.882739:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463597.882740:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463597.882741:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463597.882742:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463597.882742:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463597.882744:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463597.882745:0:19377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463597.882764:0:19377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9617873bb000 from lustre-OST0001 10000000:01000000:2.0:1788463597.882791:0:19377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788463597.882794:0:19377:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463597.882802:0:19377:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96188fbd3380 local copy 00010000:00010000:2.0:1788463597.882812:0:19377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463597.882907:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485853952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463597.882938:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.882971:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618854789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463597.883037:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485853952 00000100:00100000:1.0:1788463597.883058:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485853952 00000100:00100000:1.0:1788463597.883105:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788463597.883114:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:19377:x1875339485853952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463597.883186:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:19377:x1875339485853952:12345-0@lo:501:mount.lustre.0 Request processed in 72us (246us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463597.883312:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788463597.883394:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485853952:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788463597.883409:0:19377:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788463597.883425:0:19377:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788463597.883431:0:19377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.883440:0:19377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1400/0x841acb7f42a3a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3a83d expref: -99 pid: 17035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463597.883465:0:19377:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9617873bb000 10000000:01000000:2.0:1788463597.883470:0:19377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788463597.883474:0:19377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463597.883477:0:19377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463597.883481:0:19377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788463597.883484:0:19377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788463597.883507:0:19377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.883515:0:19377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.883524:0:19377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463597.883537:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463597.883564:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.883762:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618854789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463597.883813:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854080 00000100:00100000:1.0:1788463597.883819:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854080 00000100:00100000:1.0:1788463597.883853:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788463597.883861:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:19377:x1875339485854080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463597.883870:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463597.883883:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0de00/0x841acb7f42a3abee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3abe7 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463597.883903:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0de00/0x841acb7f42a3abee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3abe7 expref: 22 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463597.883914:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0de00/0x841acb7f42a3abee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3abe7 expref: 22 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463597.883923:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0de00, rc 0) 00000100:00100000:1.0:1788463597.883958:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854080:12345-0@lo:101:mount.lustre.0 Request processed in 98us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.883965:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463597.884059:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463597.884072:0:19377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.884091:0:19377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463597.885422:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788463597.886490:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463597.891256:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788463597.891318:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788463597.891334:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788463597.891371:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788463597.891399:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788463597.891415:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788463597.891442:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788463597.891448:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788463597.891557:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463597.891755:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463597.891917:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854208 00000100:00100000:1.0:1788463597.891924:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854208 00000100:00100000:1.0:1788463597.891976:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463597.891987:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463597.892148:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854208:12345-0@lo:501:mount.lustre.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.892156:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788463597.896343:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463597.896462:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463597.896532:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463597.896788:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.896882:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961885478300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463597.897988:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854336 00000100:00100000:3.0:1788463597.898002:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854336 00000100:00100000:3.0:1788463597.898065:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788463597.898076:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463597.899055:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854336:12345-0@lo:503:mount.lustre.0 Request processed in 978us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463597.899065:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788463597.906611:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854336:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463597.907144:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463597.907240:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463597.907316:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.907711:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961787c063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463597.907945:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854464 00000100:00100000:3.0:1788463597.907952:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854464 00000100:00100000:3.0:1788463597.908049:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788463597.908059:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463597.908691:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854464:12345-0@lo:502:mount.lustre.0 Request processed in 632us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463597.908709:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788463597.908815:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463597.909028:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788463597.909059:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788463597.909075:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788463597.909090:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788463597.909118:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788463597.909133:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788463597.909146:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788463597.909159:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788463597.909173:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788463597.909219:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463597.909260:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.910018:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618854789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463597.917557:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854592 00000100:00100000:0.0:1788463597.917590:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854592 00000100:00100000:0.0:1788463597.917652:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788463597.917663:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463597.917851:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854592:12345-0@lo:502:mount.lustre.0 Request processed in 189us (8589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463597.917859:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788463597.918228:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463597.918337:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788463597.918351:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788463597.922754:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463597.922768:0:19381:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788463597.922774:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463597.922777:0:19381:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788463597.922783:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463597.922799:0:19381:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9617871eb380) 00000020:00000080:2.0:1788463597.922825:0:19381:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788463597.922831:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463597.922919:0:19381:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9617873bb000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788463597.922928:0:19381:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463597.922934:0:19381:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x841acb7f42a3abfc 00010000:00010000:2.0:1788463597.932151:0:19381:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788463597.936496:0:19381:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788463597.939048:0:19381:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788463597.940708:0:19381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788463597.940721:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463597.940727:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463597.940729:0:19381:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788463597.940733:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463597.940737:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463597.940738:0:19381:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463597.940741:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463597.940742:0:19381:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463597.940744:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463597.940746:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463597.940747:0:19381:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788463597.940750:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463597.940752:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463597.940753:0:19381:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463597.940757:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788463597.940782:0:19381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463597.940785:0:19381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463597.940786:0:19381:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463597.940790:0:19381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788463597.943218:0:19377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788463597.943262:0:19377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788463597.943279:0:19377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.943300:0:19377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e26200/0x841acb7f42a3abe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3abee expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463597.943308:0:19377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9617873bb000 from 1 10000000:01000000:2.0:1788463597.943311:0:19377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463597.943345:0:19377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.943353:0:19377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.943364:0:19377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463597.943546:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463597.943651:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.943695:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882928600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463597.943815:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854720 00000100:00100000:3.0:1788463597.943824:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854720 00000100:00100000:3.0:1788463597.943876:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788463597.943886:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:19377:x1875339485854720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463597.943898:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463597.943912:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ac03 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.943947:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.943958:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.943967:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812400, rc 0) 00000100:00100000:3.0:1788463597.944014:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485854720:12345-0@lo:101:mount.lustre.0 Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463597.944020:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463597.944146:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463597.944161:0:19377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463597.944170:0:19377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463597.950827:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788463597.951201:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463597.951537:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788463597.951565:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788463597.952043:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788463597.952053:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788463597.952147:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463597.952221:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463597.952266:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463597.952374:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854848 00000100:00100000:2.0:1788463597.952382:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854848 00000100:00100000:2.0:1788463597.952442:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788463597.952452:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485854848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463597.952601:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485854848:12345-0@lo:501:mount.lustre.0 Request processed in 150us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463597.952609:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463597.953805:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463597.953858:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463597.953917:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463597.953957:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618b7c21b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463597.954057:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485854976 00000100:00100000:2.0:1788463597.954064:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485854976 00000100:00100000:2.0:1788463597.954113:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463597.954122:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485854976:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463597.954239:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485854976:12345-0@lo:503:mount.lustre.0 Request processed in 118us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463597.954247:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788463597.954292:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485854976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463597.954921:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463597.955008:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485855104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463597.955056:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.955083:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961882928600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463597.955150:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855104 00000100:00100000:1.0:1788463597.955156:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855104 00000100:00100000:1.0:1788463597.955205:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463597.955213:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485855104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463597.955305:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485855104:12345-0@lo:502:mount.lustre.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.955312:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788463597.961927:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485855104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463597.962204:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788463597.962238:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788463597.962252:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788463597.962266:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788463597.962279:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788463597.962311:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788463597.962326:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788463597.962339:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788463597.962351:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788463597.962362:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788463597.962376:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788463597.962431:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485855232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463597.962504:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.962557:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891d140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463597.962793:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855232 00000100:00100000:1.0:1788463597.962801:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855232 00000100:00100000:1.0:1788463597.962848:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463597.962857:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485855232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463597.962975:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485855232:12345-0@lo:502:mount.lustre.0 Request processed in 118us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.962983:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788463597.963289:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485855360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463597.963323:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463597.963408:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855360 00000100:00100000:1.0:1788463597.963413:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855360 00000100:00100000:1.0:1788463597.963453:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463597.963461:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485855360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463597.963483:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788463597.963519:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485855360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.963526:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788463597.963644:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463597.963675:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485855360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463597.963811:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485855488:0@lo:400:kworker.0 00000100:00100000:3.0:1788463597.963841:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.963964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485855616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463597.963996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.964025:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855616 00000100:00100000:2.0:1788463597.964029:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855616 00000100:00100000:2.0:1788463597.964058:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463597.964064:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485855616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788463597.964076:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788463597.964118:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485855616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463597.964124:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463597.964154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485855616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463597.964177:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485855232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463597.964254:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788463597.964264:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00080000:0.0:1788463597.964465:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463597.964470:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463597.964483:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463597.964488:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 632 00000100:00080000:0.0:1788463597.964492:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788463597.964498:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463597.964520:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9617884d6300 x1875339485855744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463597.964897:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855488 00000100:00100000:1.0:1788463597.964903:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855488 00000100:00100000:1.0:1788463597.964941:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463597.964949:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485855488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463597.968299:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485855872:0@lo:400:kworker.0 00000100:00100000:2.0:1788463597.968390:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463597.968464:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463597.970363:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485856000:0@lo:400:kworker.0 00000100:00100000:2.0:1788463597.970457:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463597.970538:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856000 00000100:00100000:2.0:1788463597.970549:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856000 00000100:00100000:2.0:1788463597.970618:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463597.970629:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485856000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463597.970709:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485856000:12345-0@lo:400:kworker.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463597.970717:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463597.970763:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485856000:0@lo:400:kworker.0 00000100:00100000:3.0:1788463597.971213:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855872 00000100:00100000:3.0:1788463597.971220:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855872 00000100:00100000:3.0:1788463597.971254:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788463597.971262:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485855872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463597.971307:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875339485855872:12345-0@lo:400:kworker.0 Request processed in 46us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463597.971313:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788463597.971345:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d6a00 x1875339485855872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463597.971371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875339485855872:0@lo:400:kworker.0 00000100:00080000:0.0:1788463597.971687:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463597.971693:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463597.971697:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463597.971703:0:1365:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:0.0:1788463597.971707:0:1365:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788463597.971712:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463597.971751:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9617884d7100 x1875339485856128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463597.971804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463597.971865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485855744:0@lo:8:kworker.0 00000100:00100000:0.0:1788463597.971911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463597.971938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485856128:0@lo:8:kworker.0 00000100:00100000:0.0:1788463597.971956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463597.971984:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485855744 00000100:00100000:0.0:1788463597.971988:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485855744 00000100:00100000:0.0:1788463597.972011:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856128 00000100:00100000:0.0:1788463597.972014:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856128 00000100:00100000:0.0:1788463597.972030:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463597.972037:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485855744:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788463597.972103:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485855744:12345-0@lo:8:kworker.0 Request processed in 55us (181us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788463597.972122:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463597.972137:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463597.972141:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485856128:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788463597.972170:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3647:x1875339485856128:12345-0@lo:8:kworker.0 Request processed in 27us (212us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788463597.972175:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463597.974111:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485856384:0@lo:400:kworker.0 00000100:00100000:0.0:1788463597.974181:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463597.974312:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463597.974321:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485856512:0@lo:400:kworker.0 00000100:00100000:0.0:1788463597.974346:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463597.974381:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856384 00000100:00100000:0.0:1788463597.974462:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856384 00000100:00100000:0.0:1788463597.974518:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856512 00000100:00100000:0.0:1788463597.974522:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856512 00000100:00100000:0.0:1788463597.974544:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463597.974554:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485856384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463597.974627:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485856384:12345-0@lo:400:kworker.0 Request processed in 75us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463597.974635:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463597.974650:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463597.974656:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485856512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463597.974682:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485856512:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463597.974688:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788463597.974703:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463597.974719:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463597.974748:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463597.974756:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463597.974761:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788463597.974764:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485855744:0@lo:8:kworker.0 00000100:00100000:0.0:1788463597.974775:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463597.974778:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463597.974781:0:3647:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788463597.974784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485856128:0@lo:8:kworker.0 00010000:00080000:0.0:1788463597.974938:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d5f80 x1875339485856512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463597.974951:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485856512:0@lo:400:kworker.0 00010000:00080000:0.0:1788463597.974961:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d4700 x1875339485856384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463597.974969:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485856384:0@lo:400:kworker.0 00000100:00100000:1.0:1788463597.980129:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485855488:12345-0@lo:400:kworker.0 Request processed in 15170us (16276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463597.980147:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463597.980798:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485856256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463597.980864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788463597.981371:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463597.981381:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981396:0:19385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788463597.981403:0:19385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9617873bb000 00000020:00000080:1.0:1788463597.981406:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463597.981414:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463597.981417:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981419:0:19385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788463597.981421:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463597.981424:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981439:0:19385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788463597.981443:0:19385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9617873bb000 00000020:00000080:1.0:1788463597.981446:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463597.981504:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463597.981508:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981509:0:19385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788463597.981512:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463597.981515:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981516:0:19385:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463597.981519:0:19385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9617873bb000 00000020:00000080:1.0:1788463597.981521:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463597.981538:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463597.981540:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981542:0:19385:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788463597.981544:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463597.981546:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981547:0:19385:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788463597.981550:0:19385:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9617873bb000 00000020:00000080:1.0:1788463597.981552:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788463597.981598:0:19385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463597.981601:0:19385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463597.981603:0:19385:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788463597.981606:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000100:00100000:0.0:1788463597.986549:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856256 00000100:00100000:0.0:1788463597.986563:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856256 00000100:00100000:0.0:1788463597.986625:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788463597.986634:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485856256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463597.986730:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485856256:12345-0@lo:400:kworker.0 Request processed in 96us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463597.986737:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788463597.986784:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d7800 x1875339485856256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463597.986799:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485856256:0@lo:400:kworker.0 00000100:00100000:3.0:1788463597.986933:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485855488:0@lo:400:kworker.0 00000020:01000000:0.0:1788463597.991755:0:19377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788463597.991807:0:19377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463597.991828:0:19377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463597.991840:0:19377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463597.991920:0:19377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788463597.991923:0:19377:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9617873bb000 10000000:01000000:0.0:1788463597.991928:0:19377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9617873bb000 10000000:01000000:0.0:1788463597.991931:0:19377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463597.991937:0:19377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9617873bb000 from 1 10000000:01000000:0.0:1788463597.991939:0:19377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463597.991974:0:19377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463597.991983:0:19377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463597.991995:0:19377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463597.992020:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788463597.992104:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463597.992149:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888ec5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463597.993481:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856640 00000100:00100000:3.0:1788463597.993491:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856640 00000100:00100000:3.0:1788463597.993546:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788463597.993555:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:19377:x1875339485856640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463597.993571:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463597.993601:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813e00/0x841acb7f42a3ac18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ac11 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.993629:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813e00/0x841acb7f42a3ac18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ac11 expref: 24 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.993642:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813e00/0x841acb7f42a3ac18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ac11 expref: 24 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.993652:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813e00, rc 0) 00000100:00100000:3.0:1788463597.993711:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485856640:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463597.993718:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788463597.993773:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463597.993789:0:19377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463597.993799:0:19377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463598.014756:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788463598.015043:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463598.015233:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788463598.015256:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788463598.015268:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788463598.015280:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788463598.015291:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788463598.015303:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788463598.015317:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788463598.015329:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788463598.015342:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788463598.015354:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788463598.015368:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788463598.015381:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788463598.015476:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788463598.015491:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788463598.015504:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788463598.015520:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788463598.015532:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788463598.015544:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788463598.015557:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788463598.015571:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788463598.015612:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788463598.015625:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788463598.015635:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788463598.015648:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788463598.015659:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788463598.015672:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788463598.015684:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788463598.015695:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788463598.015707:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788463598.015733:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788463598.015745:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788463598.015758:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788463598.015770:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788463598.015782:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788463598.015794:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788463598.015806:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788463598.015818:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788463598.015830:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788463598.015844:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788463598.015856:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788463598.015868:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788463598.015882:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788463598.015895:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788463598.015910:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788463598.015922:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788463598.015934:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788463598.015953:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788463598.015958:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788463598.016044:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463598.016124:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.016167:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463598.022552:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856768 00000100:00100000:1.0:1788463598.022569:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856768 00000100:00100000:1.0:1788463598.022656:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788463598.022667:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485856768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463598.022848:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485856768:12345-0@lo:501:mount.lustre.0 Request processed in 182us (6723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463598.022856:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788463598.022980:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463598.023034:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463598.023112:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.023142:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463598.023160:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485856896 00000100:00100000:3.0:1788463598.023165:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485856896 00000100:00100000:3.0:1788463598.023192:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463598.023198:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485856896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463598.023283:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485856896:12345-0@lo:503:mount.lustre.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.023289:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463598.023327:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485856896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463598.023758:0:19377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463598.023827:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.023865:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.023883:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463598.023897:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857024 00000100:00100000:3.0:1788463598.023902:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857024 00000100:00100000:3.0:1788463598.023924:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463598.023930:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.024004:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857024:12345-0@lo:502:mount.lustre.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.024011:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463598.024050:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463598.024228:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788463598.024253:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788463598.024268:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788463598.024282:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788463598.024296:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788463598.024308:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788463598.024322:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788463598.024348:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788463598.024362:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788463598.024376:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788463598.024388:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788463598.024410:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788463598.024423:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788463598.024436:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788463598.024448:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788463598.024459:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788463598.024473:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788463598.024485:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788463598.024499:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788463598.024510:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788463598.024523:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788463598.024534:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788463598.024547:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788463598.024597:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788463598.024617:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788463598.024630:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788463598.024644:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788463598.024656:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788463598.024668:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788463598.024679:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788463598.024691:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788463598.024705:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788463598.024718:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788463598.024732:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788463598.024743:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788463598.024755:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788463598.024767:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788463598.024781:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788463598.024794:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788463598.024821:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788463598.024835:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788463598.024848:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788463598.024861:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788463598.024874:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788463598.024898:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788463598.024912:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788463598.024926:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788463598.024939:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788463598.024974:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.025026:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.025046:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463598.025071:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857152 00000100:00100000:3.0:1788463598.025077:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857152 00000100:00100000:3.0:1788463598.025118:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788463598.025126:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.025227:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857152:12345-0@lo:502:mount.lustre.0 Request processed in 101us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.025235:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788463598.025286:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463598.025434:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788463598.025454:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788463598.025474:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.025507:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.025521:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888b1e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463598.025534:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857280 00000100:00100000:3.0:1788463598.025539:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857280 00000100:00100000:3.0:1788463598.025560:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788463598.025567:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463598.025655:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857280:12345-0@lo:502:mount.lustre.0 Request processed in 89us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.025662:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788463598.025705:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463598.025738:0:19377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788463598.025745:0:19377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788463598.046896:0:19390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788463598.046916:0:19390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96178878cd40) 00000020:00000080:3.0:1788463598.046944:0:19390:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788463598.047067:0:19390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9617873bb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788463598.047072:0:19390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9617873bb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788463598.047074:0:19390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9617873bb000 3 00010000:00080000:3.0:1788463598.047121:0:19390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96178732a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.153@tcp at head 00010000:00010000:3.0:1788463598.049809:0:19390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788463598.050027:0:19390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788463598.050078:0:19390:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463598.050102:0:19390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x841acb7f42a3ac26 00000100:00080000:3.0:1788463598.050114:0:19390:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463598.050120:0:19390:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96178732a800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:3.0:1788463598.050159:0:19390:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188fbece00 x1875339485857408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463598.050188:0:19390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463598.050543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485857408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463598.050647:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463598.050981:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857408 00000100:00100000:2.0:1788463598.050991:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857408 00000100:00100000:2.0:1788463598.051031:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463598.051039:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875339485857408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463598.051066:0:17056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:2.0:1788463598.051107:0:17056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x841acb7f42a3ac2d 00000004:00100000:2.0:1788463598.051123:0:17056:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463598.051152:0:17056:0:(import.c:65:import_set_state_nolock()) ffff9617885be000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463598.051217:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875339485857408:12345-0@lo:38:llog_process_th.0 Request processed in 178us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463598.051225:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788463598.051340:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96188fbece00 x1875339485857408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463598.051359:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463598.051367:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788463598.051373:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463598.051377:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463598.051379:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96178732a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463598.051396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3647:1875339485857408:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788463598.051505:0:19390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788463598.051523:0:19390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff96188fbd0000) 00000020:00000080:0.0:1788463598.051544:0:19390:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788463598.051688:0:19390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9617873bb000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463598.051693:0:19390:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9617873bb000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463598.051696:0:19390:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9617873bb000 3 00010000:00080000:0.0:1788463598.051721:0:19390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff961786a7e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.153@tcp at head 00010000:00010000:0.0:1788463598.053495:0:19390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788463598.053745:0:19390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788463598.053791:0:19390:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463598.053805:0:19390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x841acb7f42a3ac3b 00000100:00080000:0.0:1788463598.053816:0:19390:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463598.053822:0:19390:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff961786a7e000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463598.053860:0:19390:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9617884d5f80 x1875339485857536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463598.053884:0:19390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788463598.056127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485857536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788463598.056227:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.056306:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857536 00000100:00100000:3.0:1788463598.056314:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857536 00000100:00100000:3.0:1788463598.056352:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463598.056360:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1875339485857536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788463598.056390:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:3.0:1788463598.056442:0:17058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x841acb7f42a3ac42 00000004:00100000:3.0:1788463598.056465:0:17058:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788463598.056502:0:17058:0:(import.c:65:import_set_state_nolock()) ffff961787328000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463598.056560:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875339485857536:12345-0@lo:38:llog_process_th.0 Request processed in 199us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.056569:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788463598.056641:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9617884d5f80 x1875339485857536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463598.056652:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463598.056660:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788463598.056668:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788463598.056673:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788463598.056676:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961786a7e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788463598.056681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3647:1875339485857536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788463598.061490:0:19390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788463598.061562:0:19377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788463598.061626:0:19377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463598.061649:0:19377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463598.061669:0:19377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc1600/0x841acb7f42a3ac11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac18 expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788463598.061723:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788463598.061726:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788463598.061727:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463598.061729:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463598.061730:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463598.061731:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463598.061733:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463598.061734:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463598.061736:0:19377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463598.061741:0:19377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788463598.061744:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788463598.061746:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788463598.061747:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788463598.061749:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788463598.061750:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788463598.061751:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788463598.061752:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788463598.061754:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788463598.061755:0:19377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788463598.061780:0:19377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788463598.061797:0:19377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788463598.061862:0:19377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463598.061901:0:19377:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888ec5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463598.064513:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857664 00000100:00100000:3.0:1788463598.064526:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857664 00000100:00100000:3.0:1788463598.064593:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463598.064604:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788463598.064638:0:17050:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788463598.064653:0:17050:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788463598.066204:0:17050:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463598.066303:0:17050:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788463598.066350:0:17072:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788463598.066355:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788463598.068017:0:17072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.068046:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.068068:0:17072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 24 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.068076:0:17072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.068132:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 24 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.068148:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 24 pid: 17049 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463598.068165:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485857792:0@lo:104: 00000100:00100000:3.0:1788463598.068247:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463598.068303:0:17072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463598.068312:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857792 00010000:00010000:3.0:1788463598.068313:0:17072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 24 pid: 17051 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463598.068322:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857792 00000100:00100000:3.0:1788463598.068326:0:17072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485857920:0@lo:104: 00000100:00100000:3.0:1788463598.068355:0:17072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.068379:0:17072:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463598.068999:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:19377:x1875339485857664:12345-0@lo:253:mount.lustre.0 Request processed in 4395us (7133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463598.069010:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463598.070969:0:19377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:61537c78-f571-4169-84d6-9d8a2058e62c:19377:1875339485857664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463598.070988:0:19377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788463598.070992:0:19377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463598.070994:0:19377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463598.070995:0:19377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463598.071015:0:19377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463598.071016:0:19377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463598.071017:0:19377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463598.071018:0:19377:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463598.071020:0:19377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463598.071021:0:19377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463598.071042:0:19377:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788463598.075549:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485857920 00000100:00100000:1.0:1788463598.075589:0:17039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485857920 00000100:00100000:1.0:1788463598.075635:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463598.075645:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485857792:12345-0@lo:104: 00010000:00010000:1.0:1788463598.075665:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.075758:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463598.075765:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+4:17072:x1875339485857792:12345-0@lo:104: Request processed in 122us (7518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463598.075771:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463598.075790:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463598.075797:0:17039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485857920:12345-0@lo:104: 00010000:00010000:1.0:1788463598.075805:0:17039:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.075840:0:17039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463598.075845:0:17039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:61537c78-f571-4169-84d6-9d8a2058e62c+3:17072:x1875339485857920:12345-0@lo:104: Request processed in 50us (7492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463598.075851:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788463598.075888:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463598.075894:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.075901:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26000 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463598.075905:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.075914:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463598.075933:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463598.075939:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463598.075978:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.075984:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463598.076002:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076009:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e26000/0x841acb7f42a3ab00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ab07 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076020:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463598.076023:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076028:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463598.076030:0:17045:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076035:0:17045:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463598.076041:0:17045:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463598.076045:0:17045:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463598.076064:0:17045:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076070:0:17045:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463598.076076:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076081:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdf200/0x841acb7f42a3aaf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaf9 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.076106:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463598.076108:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463598.076109:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463598.076205:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485858176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463598.076251:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.076298:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463598.076304:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485858048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463598.076325:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.076361:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858176 00000100:00100000:3.0:1788463598.076366:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858176 00010000:00010000:3.0:1788463598.076387:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 24 pid: 17051 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463598.076408:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858048 00000100:00100000:3.0:1788463598.076411:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858048 00010000:00010000:3.0:1788463598.076424:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 25 pid: 17049 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463598.076438:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463598.076444:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+25:3651:x1875339485858176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463598.076456:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463598.076461:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 25 pid: 17051 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076471:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 25 pid: 17051 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076489:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463598.076519:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+25:3651:x1875339485858176:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.076526:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463598.076539:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463598.076545:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485858048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463598.076553:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463598.076558:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 24 pid: 17049 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076567:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 24 pid: 17049 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076610:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076619:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463598.076636:0:17042:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014312457s 00010000:00010000:3.0:1788463598.076641:0:17042:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076648:0:17042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076655:0:17042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076662:0:17042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076669:0:17042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463598.076673:0:17042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076681:0:17042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076690:0:17042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076700:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463598.076724:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485858048:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.076737:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463598.076770:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485858048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463598.076779:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485858176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463598.076814:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787bc1200/0x841acb7f42a3ab07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3ab00 expref: 23 pid: 17049 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463598.076826:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbeca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485857792:0@lo:104: 00010000:00010000:3.0:1788463598.076835:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3aaf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aaf2 expref: 22 pid: 17051 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463598.076842:0:17072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17072:1875339485857920:0@lo:104: 00010000:00010000:3.0:1788463598.076856:0:17072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076866:0:17072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076872:0:17072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463598.076879:0:17072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882813200/0x841acb7f42a3ac49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463598.083667:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788463598.097734:0:19377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788463598.109203:0:19377:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788463598.109216:0:19377:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788463598.109254:0:19377:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788463598.109776:0:19377:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788463598.109799:0:19377:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788463598.109827:0:19377:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788463598.112135:0:19377:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463598.112438:0:19377:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788463598.213135:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463598.468901:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463598.468925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485858304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788463598.468991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463598.469039:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858304 00000100:00100000:3.0:1788463598.469056:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858304 00000100:00100000:3.0:1788463598.469113:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463598.469123:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485858304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463598.469157:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463598.469206:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485858304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463598.469213:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788463598.469263:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485858304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463598.473990:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485858432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463598.474065:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463598.474834:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858432 00000100:00100000:1.0:1788463598.474844:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858432 00000100:00100000:1.0:1788463598.474895:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463598.474905:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485858432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463598.474938:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463598.479166:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485858432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4252us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463598.479180:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788463598.480891:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485858432:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788463599.240480:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463599.300473:0:19444:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463599.301367:0:19444:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788463599.365500:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788463599.365509:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96188cec8000 from 10 10000000:01000000:2.0:1788463599.365514:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463599.365571:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463599.365599:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463599.365611:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463599.365637:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463599.365713:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463599.365765:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d09d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463599.366831:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858560 00000100:00100000:3.0:1788463599.366842:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858560 00000100:00100000:3.0:1788463599.366911:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463599.366922:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485858560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463599.366937:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463599.366955:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813200/0x841acb7f42a3ac57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ac50 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463599.367278:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813200/0x841acb7f42a3ac57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ac50 expref: 23 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463599.367292:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813200/0x841acb7f42a3ac57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ac50 expref: 23 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463599.367301:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813200, rc 0) 00000100:00100000:3.0:1788463599.367380:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485858560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 459us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463599.367387:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463599.367860:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463599.367890:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463599.367900:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463599.367961:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788463599.368013:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463599.368043:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188d09d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463599.368235:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858688 00000100:00100000:0.0:1788463599.368242:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858688 00000100:00100000:0.0:1788463599.368288:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788463599.368303:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485858688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788463599.368320:0:17050:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463599.368336:0:17050:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463599.368339:0:17050:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788463599.368432:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485858688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463599.368439:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788463599.368475:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fa1bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788463599.368554:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463599.368562:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.368571:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff9618c1e27600/0x841acb7f42a3ac50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac57 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463599.368600:0:17054:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463599.368602:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff96189154b000 from 10 10000000:01000000:0.0:1788463599.368604:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463599.368627:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.368635:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.368642:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463599.368654:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463599.368688:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463599.369807:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888ec5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463599.369830:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858816 00000100:00100000:0.0:1788463599.369838:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858816 00000100:00100000:0.0:1788463599.369880:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463599.369889:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485858816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463599.369900:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463599.369916:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787bc1000/0x841acb7f42a3ac65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ac5e expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.369938:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787bc1000/0x841acb7f42a3ac65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ac5e expref: 24 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.369947:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787bc1000/0x841acb7f42a3ac65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ac5e expref: 24 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.369955:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787bc1000, rc 0) 00000100:00100000:0.0:1788463599.370003:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485858816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463599.370009:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788463599.370051:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463599.370077:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463599.370087:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463599.371451:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788463599.371517:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463599.375075:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888ec5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463599.379872:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485858944 00000100:00100000:3.0:1788463599.379888:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485858944 00000100:00100000:3.0:1788463599.380050:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463599.380060:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485858944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788463599.380847:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788463599.380873:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788463599.380877:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788463599.381031:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485858944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 972us (9512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463599.381040:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788463599.381145:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485858944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463599.381219:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463599.381229:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463599.381249:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787bc0400/0x841acb7f42a3ac5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ac65 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463599.634293:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463600.268458:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463601.285160:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463602.312788:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463603.075771:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463603.075778:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463603.075783:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463603.075795:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff961787d22000 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463603.075817:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9617884d7800 x1875339485859456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463603.075847:0:1365:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463603.075850:0:1365:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463603.075851:0:1365:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463603.075855:0:1365:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff961891880800 using connection 192.168.204.153@tcp/0@lo 00000100:00100000:0.0:1788463603.075865:0:1365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96188cf31f80 x1875339485859968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463603.075920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485859328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076009:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.076058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485860096:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076086:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.076102:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485860608:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076125:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.076152:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788463603.076157:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485859584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.076203:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485860224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.076257:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859328 00000100:00100000:0.0:1788463603.076264:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859328 00000100:00100000:0.0:1788463603.076770:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463603.076782:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485859328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.076841:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485859328:12345-0@lo:400:kworker.0 Request processed in 62us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.076848:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463603.076873:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860096 00000100:00100000:0.0:1788463603.076877:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860096 00000100:00100000:0.0:1788463603.076895:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860608 00000100:00100000:0.0:1788463603.076898:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860608 00000100:00100000:0.0:1788463603.076913:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859584 00000100:00100000:0.0:1788463603.076916:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859584 00000100:00100000:0.0:1788463603.076924:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860224 00000100:00100000:0.0:1788463603.076926:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860224 00000100:00100000:0.0:1788463603.076939:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463603.076945:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485860096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.077188:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485860096:12345-0@lo:400:kworker.0 Request processed in 241us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.077195:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463603.077208:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463603.077215:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485860608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.077244:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485860608:12345-0@lo:400:kworker.0 Request processed in 31us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.077249:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463603.077260:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463603.077275:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485859584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.077540:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485859584:12345-0@lo:400:kworker.0 Request processed in 265us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.077547:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463603.077558:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463603.077564:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485860224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.077779:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485859200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.077815:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.077849:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485859840:0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.077870:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.077888:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485860480:0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.077915:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.077930:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788463603.077936:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485859072:0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.077973:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.078005:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485859712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.078243:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485860224:12345-0@lo:400:kworker.0 Request processed in 678us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.078250:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463603.078265:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860480 00000100:00100000:0.0:1788463603.078271:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860480 00000100:00100000:3.0:1788463603.078534:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.078558:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485860352:0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.078602:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.078772:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860352 00000100:00100000:0.0:1788463603.078775:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860352 00000100:00100000:0.0:1788463603.078794:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463603.078800:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485860480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463603.078861:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485859456:0@lo:8:kworker.0 00000100:00100000:0.0:1788463603.079436:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875339485860480:12345-0@lo:400:kworker.0 Request processed in 633us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.079443:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463603.079462:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463603.079470:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485860352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.079502:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485860352:12345-0@lo:400:kworker.0 Request processed in 34us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.079508:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788463603.079525:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463603.079529:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788463603.079532:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463603.079544:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859840 00000100:00100000:0.0:1788463603.079556:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859840 00000100:00100000:0.0:1788463603.079748:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463603.079756:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485859840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.079804:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485859840:12345-0@lo:400:kworker.0 Request processed in 49us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.079810:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463603.079910:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463603.079941:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463603.079972:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463603.080010:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d4e00 x1875339485859584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080290:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485859584:0@lo:400:kworker.0 00010000:00080000:0.0:1788463603.080312:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32300 x1875339485860224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485860224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.080780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485859328:0@lo:400:kworker.0 00010000:00080000:0.0:1788463603.080791:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf31c00 x1875339485860096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080799:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485860096:0@lo:400:kworker.0 00010000:00080000:0.0:1788463603.080809:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf31500 x1875339485860608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080816:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485860608:0@lo:400:kworker.0 00010000:00080000:0.0:1788463603.080864:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf30000 x1875339485860352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080884:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485860352:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.080899:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485859840:0@lo:400:kworker.0 00010000:00080000:0.0:1788463603.080910:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf32a00 x1875339485860480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.080918:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3651:1875339485860480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.081028:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859200 00000100:00100000:0.0:1788463603.081035:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859200 00000100:00100000:0.0:1788463603.081072:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859712 00000100:00100000:0.0:1788463603.081076:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859712 00000100:00100000:0.0:1788463603.081091:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463603.081098:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485859200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.081152:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485859200:12345-0@lo:400:kworker.0 Request processed in 54us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.081158:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463603.081171:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463603.081177:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485859712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.081206:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485859712:12345-0@lo:400:kworker.0 Request processed in 29us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.081212:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463603.081239:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485859712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463603.081250:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485859200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463603.082768:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859072 00000100:00100000:2.0:1788463603.082780:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859072 00000100:00100000:2.0:1788463603.082830:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788463603.082838:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485859072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463603.082912:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485859072:12345-0@lo:400:kworker.0 Request processed in 75us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463603.082919:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788463603.082951:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860736 00000100:00100000:2.0:1788463603.082959:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860736 00000100:00100000:2.0:1788463603.082984:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463603.083001:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485860736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463603.083034:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788463603.083074:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485860736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463603.083080:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463603.083134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463603.083166:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485859072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463603.084617:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485860864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463603.084677:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.084880:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860864 00000100:00100000:0.0:1788463603.084888:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860864 00000100:00100000:0.0:1788463603.084940:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463603.084949:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485860864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463603.084978:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788463603.085044:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485860864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.085050:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463603.085516:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485860864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788463603.087541:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463603.087746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485859968:0@lo:8:kworker.0 00000100:00100000:2.0:1788463603.087785:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.087899:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859456 00000100:00100000:0.0:1788463603.087908:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859456 00000100:00100000:0.0:1788463603.087948:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485859968 00000100:00100000:0.0:1788463603.087952:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485859968 00000100:00100000:0.0:1788463603.087983:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463603.087990:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485859456:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463603.088043:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:0.0:1788463603.088073:0:18564:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x841acb7f42a3ac6c 00002000:00100000:0.0:1788463603.088087:0:18564:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff961786a7a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788463603.088091:0:18564:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788463603.088094:0:18564:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788463603.088746:0:18564:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463603.088774:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961786a78800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463603.088836:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875339485859456:12345-0@lo:8:kworker.0 Request processed in 844us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.088843:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463603.088864:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463603.088868:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3647:x1875339485859968:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788463603.088885:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:0.0:1788463603.088902:0:18564:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x841acb7f42a3ac73 00002000:00100000:0.0:1788463603.088910:0:18564:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff961786a7c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788463603.088924:0:18564:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788463603.088926:0:18564:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788463603.088955:0:18564:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00010000:00080000:2.0:1788463603.089100:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9617884d7800 x1875339485859456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463603.089115:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788463603.089123:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788463603.089127:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788463603.089130:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961787d22000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788463603.089142:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788463603.089146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3647:1875339485859456:0@lo:8:kworker.0 00000004:00080000:2.0:1788463603.089190:0:17083:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788463603.089208:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17083:1875339485861120:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788463603.089237:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463603.089256:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff961786bf0300 going to sleep for 11 seconds 00000004:00080000:2.0:1788463603.089269:0:17082:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788463603.089776:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861120 00000100:00100000:3.0:1788463603.089783:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861120 00000100:00100000:3.0:1788463603.089830:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463603.089839:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17083:x1875339485861120:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788463603.090509:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961786a7d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463603.090561:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875339485859968:12345-0@lo:8:kworker.0 Request processed in 1691us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.090569:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:2.0:1788463603.090792:0:17082:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 642542215352ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788463603.090798:0:17082:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788463603.090831:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463603.090845:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485860992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463603.090883:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463603.090920:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485860992 00000100:00100000:2.0:1788463603.090932:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485860992 00010000:00080000:0.0:1788463603.092084:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188cf31f80 x1875339485859968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463603.092102:0:3647:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788463603.092110:0:3647:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463603.092115:0:3647:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788463603.092118:0:3647:0:(import.c:65:import_set_state_nolock()) ffff961891880800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463603.092131:0:3647:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463603.092136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3647:1875339485859968:0@lo:8:kworker.0 00000004:00080000:0.0:1788463603.092169:0:17799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788463603.092254:0:17799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 642543678912ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788463603.092260:0:17799:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1788463603.092383:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463603.094440:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463603.094473:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485860992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463603.094513:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463603.094639:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485860992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463603.094646:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:3.0:1788463603.098631:0:17800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788463603.098661:0:17800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861376:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788463603.098723:0:17800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.098753:0:17800:0:(client.c:2716:ptlrpc_set_wait()) set ffff961888f3a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463603.098907:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861376 00000100:00100000:3.0:1788463603.098914:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861376 00000100:00100000:3.0:1788463603.098979:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463603.098988:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17800:x1875339485861376:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1788463603.099048:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463603.099060:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463603.099071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485861248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788463603.099099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.099150:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861248 00000100:00100000:3.0:1788463603.099154:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861248 00000100:00100000:3.0:1788463603.099177:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463603.099184:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875339485861248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788463603.099197:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463603.099241:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875339485861248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463603.099247:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788463603.099285:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fba8000 x1875339485861248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463603.099304:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485861248:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788463603.099555:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787e19500 x1875339485860992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463603.099617:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485860992:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788463603.104639:0:17789:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788463603.109447:0:17036:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788463603.115426:0:18562:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788463603.115438:0:18562:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788463603.115445:0:18562:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:0.0:1788463603.115524:0:18563:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788463603.115530:0:18563:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788463603.115654:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17800:x1875339485861376:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16664us (16927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.115664:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788463603.115737:0:17800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fbaa680 x1875339485861376/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.115752:0:17800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbaa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861376:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788463603.115775:0:17800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788463603.115812:0:17800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861504:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788463603.115845:0:17800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.115866:0:17800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463603.115883:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861504 00000100:00100000:0.0:1788463603.115888:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861504 00000100:00100000:0.0:1788463603.115925:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463603.115932:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17800:x1875339485861504:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788463603.115953:0:18564:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788463603.116134:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17800:x1875339485861504:12345-0@lo:5:osp-pre-1-1.0 Request processed in 202us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.116140:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788463603.116165:0:17800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96189162aa00 x1875339485861504/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463619 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463603.116173:0:17800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861504:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788463603.116182:0:17800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788463603.116204:0:17800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861632:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788463603.116222:0:17800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.116234:0:17800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463603.116243:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861632 00000100:00100000:0.0:1788463603.116246:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861632 00000100:00100000:0.0:1788463603.116263:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463603.116268:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17800:x1875339485861632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788463603.116292:0:18563:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1788463603.139677:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.139690:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.139707:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.139713:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.139720:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.139742:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.139752:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.139759:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.139777:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463603.141246:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463603.141258:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.141270:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882812000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463603.141275:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.141297:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.141327:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.141335:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e426dbc/0x841acb7f42a3ac7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.141358:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463603.141360:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463603.141362:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463603.141983:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.142001:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.142019:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.142024:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.142031:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.142043:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.142053:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.142060:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.142082:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463603.142946:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.142955:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143139:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463603.143146:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143155:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463603.143160:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143170:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143186:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143194:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c08e155b/0x841acb7f42a3ac81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.143212:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463603.143214:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463603.143216:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.144234:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.144239:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.144246:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144260:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144284:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144483:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144523:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.144533:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.144538:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144545:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.144549:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144558:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.144570:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.145084:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000361a4a0e/0x841acb7f42a3ac88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.145113:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.145125:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.145127:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463603.147530:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.147542:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.147559:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.147563:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.147571:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149108:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149126:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149135:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149156:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.149170:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.149176:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149184:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.149188:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149208:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149224:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149231:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065dee744/0x841acb7f42a3ac8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.149256:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.149258:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.149260:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463603.152790:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.152805:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.152823:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.152828:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.152835:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.152851:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.152860:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.152878:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.152900:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463603.153102:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.153114:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.153123:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.153128:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.153138:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.153158:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.153166:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d073cd17/0x841acb7f42a3ac96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.153186:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.153188:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.153189:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463603.155886:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788463603.155898:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.155917:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=642s v=(0 0) 00010000:00010000:3.0:1788463603.155921:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463603.155928:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.155942:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.155952:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.155970:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156001:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.156013:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.156020:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156035:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961882813000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.156040:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156051:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156068:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156075:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039828a0b/0x841acb7f42a3ac9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.156094:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.156096:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.156098:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463603.170526:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463603.170539:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.170556:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788463603.170561:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463603.170567:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.171151:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.171165:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.171173:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.171516:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.171982:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.172002:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.172012:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.172016:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.172027:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.172051:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.172058:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc800c82/0x841acb7f42a3aca4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.172079:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.172081:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.172083:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.172837:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.172846:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.172859:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.172864:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.172870:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.172896:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.172905:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.172913:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.172929:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.174434:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.174443:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.174455:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.174460:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.174471:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.174489:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.174497:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3acab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.174530:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.174532:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.174534:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.175548:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.175559:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.175804:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.175810:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.175818:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.175833:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.175843:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.175865:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.175884:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463603.179755:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.179768:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.179787:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.179792:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.179798:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.179815:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.179827:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.179836:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.179856:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:1.0:1788463603.183307:0:19378:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788463603.183541:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788463603.183546:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788463603.183848:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17800:x1875339485861632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67575us (67620us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788463603.183858:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463603.183909:0:17800:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788463603.183917:0:17800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17800:1875339485861632:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788463603.183933:0:17800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788463603.184074:0:17800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17800:1875339485861760:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788463603.184113:0:17800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463603.184139:0:17800:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463603.184166:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861760 00000100:00100000:1.0:1788463603.184172:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861760 00000100:00100000:1.0:1788463603.184210:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463603.184218:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17800:x1875339485861760:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788463603.184260:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17800:x1875339485861760:12345-0@lo:900:osp-pre-1-1.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463603.184267:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1788463603.185744:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.185759:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.185786:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.185791:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.185798:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.185814:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.185824:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.185833:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.185845:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00080000:1.0:1788463603.186804:0:17800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727c380 x1875339485861760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788463619 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463603.186821:0:17800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17800:1875339485861760:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788463603.187805:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463603.187817:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187831:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.187837:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187850:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187870:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187878:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3acb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187902:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463603.187906:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187913:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.187925:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187933:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187944:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.187952:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3acb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463603.188086:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.188094:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.188105:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.188110:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.188116:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.188130:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.188152:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.188160:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.188173:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463603.188444:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463603.188449:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188457:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.188461:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188469:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188481:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188488:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3acc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188508:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.188512:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188518:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.188521:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188529:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188540:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188548:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.188562:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.188565:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.188567:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.189240:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.190571:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.191082:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.191100:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.191105:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.191112:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.191129:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.191141:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.191148:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.191186:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.191830:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.191838:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.191847:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.191859:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.191869:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.191889:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.191897:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.191921:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.191923:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.191924:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463603.210681:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463603.210694:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.210711:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788463603.210715:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463603.210721:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.210747:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.210757:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.210765:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.210786:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463603.211570:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.211627:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.211636:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.211641:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.211653:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.211672:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.211686:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5eaf61/0x841acb7f42a3acd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.211708:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.211709:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.211711:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788463603.212007:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463603.212014:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212025:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788463603.212028:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463603.212033:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212043:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212052:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212069:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212093:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788463603.212542:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463603.212548:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212557:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788463603.212560:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463603.212565:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212842:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212852:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212859:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.212917:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788463603.213983:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788463603.214002:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.214023:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=642s v=(0 0) 00010000:00010000:2.0:1788463603.214027:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463603.214032:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.214043:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.214052:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463603.214060:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214276:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463603.214457:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214467:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.214472:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214482:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214500:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214508:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7c7c3c/0x841acb7f42a3acdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214528:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463603.214532:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214538:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26400 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.214541:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214563:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214589:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214736:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fc576e4/0x841acb7f42a3ace3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214750:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.214753:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214760:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.214763:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214772:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214783:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.214792:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.214794:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.214803:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.214876:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463603.215082:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788463603.215088:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033daa1f/0x841acb7f42a3acea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463603.216609:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788463603.216620:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.216647:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=642s v=(0 0) 00010000:00010000:1.0:1788463603.216651:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463603.216658:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.216672:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.216681:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.216688:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.217819:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.217830:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.217841:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0d200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.217846:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.217856:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.217874:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.217884:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.217886:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.217888:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.217937:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788463603.217944:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007096225a/0x841acb7f42a3acf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463603.219123:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.219133:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219147:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.219151:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.219158:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219171:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219201:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219209:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219224:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463603.219377:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.219383:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219391:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.219395:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219403:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219417:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219424:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d853c02f/0x841acb7f42a3acf8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.219440:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.219448:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.219450:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.221349:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.221360:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.221375:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.221379:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.221385:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.221396:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.221406:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.221413:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.221432:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463603.222048:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.222055:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.222063:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1800 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.222068:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.222090:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.222108:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.222116:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287c84ce/0x841acb7f42a3acff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.222136:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.222138:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.222140:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.222214:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.223215:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.223224:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223237:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.223242:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.223247:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223258:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223267:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223303:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223720:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463603.223915:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463603.223921:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223930:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463603.223935:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.223945:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.224114:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.224123:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ae9139/0x841acb7f42a3ad06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.224144:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.224146:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.224147:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.225551:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.225569:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.225726:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.225731:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.225738:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.225753:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.225763:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.225770:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.225795:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463603.226891:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463603.226901:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.226911:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.226917:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.226942:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.227392:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.227404:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d89770/0x841acb7f42a3ad0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.227428:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.227430:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.227432:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.228230:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.228239:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.228253:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.228256:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.228262:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.228273:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.228302:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.228309:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.228339:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463603.228925:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463603.228932:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.228942:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc0000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.228947:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.228958:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.228985:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.229016:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bbab4d5/0x841acb7f42a3ad14 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.229036:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.229038:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.229040:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.229857:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.229866:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.229878:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.229882:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.229888:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.229899:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.229907:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.229915:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.229945:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463603.230777:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463603.230786:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.230796:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787bc1e00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.230801:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.230811:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.230828:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.230836:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086800d02/0x841acb7f42a3ad1b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.230857:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.230859:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.230861:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.231018:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.231024:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.231035:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.231038:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.231043:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.231054:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.231062:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.231070:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.231091:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463603.231308:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463603.231314:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.231332:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5000 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.231336:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.231343:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.231355:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.231362:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3ad22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.231376:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.231377:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.231379:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.232218:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.232226:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.232238:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.232250:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.232256:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.232267:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.232276:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.232523:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.232614:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463603.234414:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.234427:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.234444:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.234459:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.234466:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.234480:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.234490:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.234504:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235231:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463603.235241:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235251:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.235256:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235418:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235439:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235458:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5e7d66f/0x841acb7f42a3ad29 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235483:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463603.235487:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235494:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463603.235497:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235504:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235515:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.235523:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.235524:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463603.235533:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463603.238087:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463603.238102:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054cb8291/0x841acb7f42a3ad30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463603.239513:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463603.240311:0:18562:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788463603.240334:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.240352:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=642s v=(0 0) 00010000:00010000:0.0:1788463603.240358:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463603.240365:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.240381:0:18562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.240393:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.240403:0:18562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463603.240441:0:18562:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788463603.240525:0:18562:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1788463603.240930:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17083:x1875339485861120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 151089us (151688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.240942:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788463603.241174:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463603.241181:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.241191:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:3.0:1788463603.241196:0:17044:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.241205:0:17044:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.241224:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.241232:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb2e77f5/0x841acb7f42a3ad37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463603.241255:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.241264:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463603.241266:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463603.241556:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17083:1875339485861120:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788463603.242051:0:17083:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788463603.242155:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17083:1875339485861888:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788463603.242204:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463603.242234:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188689fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463603.242296:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485861888 00000100:00100000:0.0:1788463603.242304:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485861888 00000100:00100000:0.0:1788463603.243132:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463603.243145:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17083:x1875339485861888:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788463603.243187:0:18564:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788463603.250389:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17083:x1875339485861888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7241us (8178us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788463603.250401:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463603.251040:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17083:1875339485861888:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788463603.251057:0:17083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1788463603.332687:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463603.587722:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485862016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788463603.587794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.587859:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862016 00000100:00100000:0.0:1788463603.587867:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862016 00000100:00100000:0.0:1788463603.587918:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463603.587928:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485862016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463603.587989:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788463603.588039:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485862016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.588045:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463603.588098:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485862016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463603.588780:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463603.588793:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485862144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463603.588835:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463603.588899:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862144 00000100:00100000:0.0:1788463603.588905:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862144 00000100:00100000:0.0:1788463603.588940:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463603.588949:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485862144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463603.589087:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463603.589134:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485862144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 186us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463603.589140:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463603.589202:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485862144:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788463604.356414:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463604.676926:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463605.383062:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463605.952455:0:19734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788463606.417126:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463607.437777:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788463607.510258:0:19786:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788463607.510548:0:19786:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788463608.195859:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463608.195888:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463608.195968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463608.196041:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862272 00000100:00100000:3.0:1788463608.196048:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862272 00000100:00100000:3.0:1788463608.196100:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463608.196109:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485862272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463608.196138:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463608.196176:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485862272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463608.196183:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788463608.196204:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463608.196240:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485862272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463608.196697:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485862400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463608.196733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463608.196811:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862400 00000100:00100000:2.0:1788463608.196817:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862400 00000100:00100000:2.0:1788463608.196875:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463608.196883:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485862400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788463608.196912:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463608.196946:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485862400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463608.196952:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788463608.197229:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463608.197270:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485862400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463608.197515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463608.197525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485862528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463608.197561:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.197615:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862528 00000100:00100000:1.0:1788463608.197620:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862528 00000100:00100000:1.0:1788463608.197652:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463608.197659:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485862528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463608.197676:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788463608.197706:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485862528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463608.197712:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788463608.197729:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463608.197747:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485862528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463608.197985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485862912:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198029:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485863424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463608.198085:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485863040:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485863552:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198136:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198158:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485862656:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198183:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485863168:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198231:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198260:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485863680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198284:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198303:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788463608.198308:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485862784:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.198328:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.198343:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485863296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.198650:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862912 00000100:00100000:0.0:1788463608.198655:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862912 00000100:00100000:0.0:1788463608.198682:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863424 00000100:00100000:0.0:1788463608.198684:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863424 00000100:00100000:0.0:1788463608.198703:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863552 00000100:00100000:0.0:1788463608.198706:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863552 00000100:00100000:0.0:1788463608.198716:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863680 00000100:00100000:0.0:1788463608.198719:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863680 00000100:00100000:0.0:1788463608.198733:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463608.198740:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485862912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.198782:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485862912:12345-0@lo:400:kworker.0 Request processed in 43us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.198789:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463608.198801:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463608.198806:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485863424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.198834:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485863424:12345-0@lo:400:kworker.0 Request processed in 29us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.198840:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463608.198849:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463608.198854:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485863552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.198875:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485863552:12345-0@lo:400:kworker.0 Request processed in 21us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.198881:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463608.198891:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463608.198908:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485863680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.198933:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485863680:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.198939:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463608.198961:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863040 00000100:00100000:0.0:1788463608.198964:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863040 00000100:00100000:0.0:1788463608.198984:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862784 00000100:00100000:0.0:1788463608.198986:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862784 00000100:00100000:0.0:1788463608.198998:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463608.199003:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485863040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.199032:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485863040:12345-0@lo:400:kworker.0 Request processed in 29us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.199038:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463608.199049:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463608.199055:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485862784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.199080:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485862784:12345-0@lo:400:kworker.0 Request processed in 26us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463608.199095:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788463608.199420:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863168 00000100:00100000:3.0:1788463608.199424:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863168 00000100:00100000:3.0:1788463608.199458:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463608.199465:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485863168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463608.199495:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485863168:12345-0@lo:400:kworker.0 Request processed in 32us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463608.199516:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463608.199538:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485862656 00000100:00100000:3.0:1788463608.199542:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485862656 00000100:00100000:3.0:1788463608.199567:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788463608.199592:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3650:x1875339485862656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463608.199619:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3650:x1875339485862656:12345-0@lo:400:kworker.0 Request processed in 47us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463608.199625:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788463608.199659:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463608.199663:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463608.199665:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463608.199679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485863936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463608.199701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463608.199731:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485863040:0@lo:400:kworker.0 00010000:00080000:3.0:1788463608.199743:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23100 x1875339485863552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463608.199754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485863552:0@lo:400:kworker.0 00010000:00080000:3.0:1788463608.199762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96178727d880 x1875339485862912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463608.199770:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485862912:0@lo:400:kworker.0 00010000:00080000:3.0:1788463608.199778:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f20700 x1875339485863424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463608.199786:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485863424:0@lo:400:kworker.0 00000100:00100000:3.0:1788463608.199824:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863936 00000100:00100000:3.0:1788463608.199832:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863936 00000100:00100000:3.0:1788463608.199852:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463608.199857:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485863936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463608.199870:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463608.199918:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485863936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463608.199924:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463608.199954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485863936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463608.200890:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.200970:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485863808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.201000:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.207083:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485862656:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.207122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485863168:0@lo:400:kworker.0 00010000:00080000:1.0:1788463608.207145:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23480 x1875339485863680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463608.207155:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485863680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463608.210934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485862784:0@lo:400:kworker.0 00000100:00100000:0.0:1788463608.211912:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863296 00000100:00100000:0.0:1788463608.211923:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863296 00000100:00100000:2.0:1788463608.212057:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485863808 00000100:00100000:2.0:1788463608.212062:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485863808 00000100:00080000:1.0:1788463608.212212:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788463608.212423:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463608.212437:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463608.212628:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485863296:12345-0@lo:400:kworker.0 Request processed in 194us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463608.212636:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463608.212656:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788463608.212662:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485863808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463608.212696:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485863808:12345-0@lo:400:kworker.0 Request processed in 35us (11694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463608.212702:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788463608.212886:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f21500 x1875339485863296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463608.212912:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485863296:0@lo:400:kworker.0 00010000:00080000:1.0:1788463608.212926:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961787f23b80 x1875339485863808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463608.212935:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485863808:0@lo:400:kworker.0 00010000:00010000:1.0:1788463608.457539:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463608.713096:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463608.713119:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485864064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463608.713188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463608.713236:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864064 00000100:00100000:2.0:1788463608.713244:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864064 00000100:00100000:2.0:1788463608.713296:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463608.713304:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485864064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788463608.713336:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788463608.713387:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485864064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463608.713394:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463608.713437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485864064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463608.713682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961787f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485864192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463608.713709:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463608.713994:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864192 00000100:00100000:1.0:1788463608.714000:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864192 00000100:00100000:1.0:1788463608.714371:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788463608.714380:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485864192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788463608.714400:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463608.714450:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485864192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463608.714456:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463608.715190:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961787f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485864192:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788463608.726641:0:19378:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:1.0:1788463608.813673:0:19836:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788463608.814163:0:19836:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788463609.245524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.245712:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889088 00000100:00100000:2.0:1788463609.245723:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889088 00000100:00100000:2.0:1788463609.245769:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:2.0:1788463609.245778:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1875339466889088:12345-192.168.204.53@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788463609.245810:0:17050:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c701ce0f-5243-483e-b03d-f799276c6ff2@192.168.204.53@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:2.0:1788463609.245843:0:17050:0:(genops.c:1385:class_connect()) connect: client c701ce0f-5243-483e-b03d-f799276c6ff2, cookie 0x841acb7f42a3ad3e 00000100:00080000:2.0:1788463609.246020:0:17050:0:(import.c:65:import_set_state_nolock()) ffff9617885bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463609.246093:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+5:2399:x1875339466889088:12345-192.168.204.53@tcp:250:mount.lustre.0 Request processed in 314us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.246101:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 115 00000100:00100000:1.0:1788463609.253439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.253603:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889216 00000100:00100000:3.0:1788463609.253615:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889216 00000100:00100000:3.0:1788463609.253675:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:3.0:1788463609.253684:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+5:14908:x1875339466889216:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463609.253701:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463609.253718:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813600/0x841acb7f42a3ad45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ab0 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.253747:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813600/0x841acb7f42a3ad45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab0 expref: 6 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.253758:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813600/0x841acb7f42a3ad45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab0 expref: 6 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.253767:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813600, rc 0) 00000100:00100000:3.0:1788463609.253835:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+6:14908:x1875339466889216:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 151us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.253841:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 116 00000100:00100000:0.0:1788463609.260176:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.260346:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889344 00000100:00100000:3.0:1788463609.260358:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889344 00000100:00100000:3.0:1788463609.260419:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 117 00000100:00100000:3.0:1788463609.260429:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+6:14908:x1875339466889344:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788463609.260565:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+6:14908:x1875339466889344:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 137us (400us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463609.260609:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 117 00000100:00100000:0.0:1788463609.266467:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.266626:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889472 00000100:00100000:2.0:1788463609.266636:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889472 00000100:00100000:2.0:1788463609.266697:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:2.0:1788463609.266707:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+6:14908:x1875339466889472:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788463609.266723:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463609.266743:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3ad4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ab7 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.266772:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3ad4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab7 expref: 7 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.266783:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26e00/0x841acb7f42a3ad4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ab7 expref: 7 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.267047:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26e00, rc 0) 00000100:00100000:2.0:1788463609.267099:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+7:14908:x1875339466889472:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 393us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.267105:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 118 00000100:00100000:1.0:1788463609.281198:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.282370:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889600 00000100:00100000:2.0:1788463609.282384:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889600 00000100:00100000:2.0:1788463609.282455:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:2.0:1788463609.282466:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+7:14908:x1875339466889600:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463609.282676:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14908:x1875339466889600:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 211us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.282684:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 119 00000100:00100000:0.0:1788463609.284733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.284827:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889728 00000100:00100000:3.0:1788463609.284836:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889728 00000100:00100000:3.0:1788463609.284893:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:3.0:1788463609.284904:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14908:x1875339466889728:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463609.285031:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14908:x1875339466889728:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 129us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.285039:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 120 00000100:00100000:0.0:1788463609.299654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.301042:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889856 00000100:00100000:3.0:1788463609.301058:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889856 00000100:00100000:3.0:1788463609.301126:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:3.0:1788463609.301136:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466889856:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463609.301321:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466889856:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 185us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.301329:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 121 00000100:00100000:1.0:1788463609.336702:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463609.336824:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466889984 00000100:00100000:0.0:1788463609.336839:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466889984 00000100:00100000:0.0:1788463609.336923:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:0.0:1788463609.336935:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466889984:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463609.337236:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466889984:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 301us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463609.337245:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 122 00000100:00100000:0.0:1788463609.353083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.353229:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890112 00000100:00100000:2.0:1788463609.353246:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890112 00000100:00100000:2.0:1788463609.353345:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:2.0:1788463609.353356:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466890112:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463609.353536:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14926:x1875339466890112:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 180us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.353544:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 123 00000100:00100000:1.0:1788463609.357847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.357989:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890240 00000100:00100000:3.0:1788463609.358005:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890240 00000100:00100000:3.0:1788463609.358077:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:3.0:1788463609.358090:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+8:14908:x1875339466890240:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463609.358136:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463609.358237:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813000/0x841acb7f42a3ad53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ae8 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.358282:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813000/0x841acb7f42a3ad53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ae8 expref: 9 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.358296:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813000/0x841acb7f42a3ad53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ae8 expref: 9 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463609.358309:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813000, rc 0) 00000100:00100000:3.0:1788463609.358461:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+9:14908:x1875339466890240:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 373us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.358469:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 124 00000100:00100000:1.0:1788463609.363228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463609.363614:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890368 00000100:00100000:0.0:1788463609.363632:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890368 00000100:00100000:0.0:1788463609.363722:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:0.0:1788463609.363737:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+9:14908:x1875339466890368:12345-192.168.204.53@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788463609.363779:0:17051:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788463609.363821:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463609.363826:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788463609.363830:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788463609.363833:0:17051:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788463609.363843:0:17051:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788463609.365829:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+9:14908:x1875339466890368:12345-192.168.204.53@tcp:256:mount.lustre.0 Request processed in 2080us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.365850:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 125 00000100:00100000:1.0:1788463609.369848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.369982:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890496 00000100:00100000:2.0:1788463609.369996:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890496 00000100:00100000:2.0:1788463609.370074:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:2.0:1788463609.370114:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+9:14908:x1875339466890496:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788463609.370138:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463609.370173:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476aef expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.370214:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 10 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.370229:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 10 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.370241:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26000, rc 0) 00000100:00100000:2.0:1788463609.370427:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14908:x1875339466890496:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 325us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.370435:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 126 00000100:00100000:1.0:1788463609.374889:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.375056:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890624 00000100:00100000:2.0:1788463609.375072:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890624 00000100:00100000:2.0:1788463609.375440:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:2.0:1788463609.375454:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618ad1d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14908:x1875339466890624:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463609.375754:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618ad1d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14908:x1875339466890624:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 303us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.375763:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 127 00000100:00100000:0.0:1788463609.378617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.378790:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890752 00000100:00100000:3.0:1788463609.378804:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890752 00000100:00100000:3.0:1788463609.378885:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:3.0:1788463609.378900:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14908:x1875339466890752:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463609.379301:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14908:x1875339466890752:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 404us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.379309:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 128 00000100:00100000:1.0:1788463609.386255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463609.387976:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466890880 00000100:00100000:0.0:1788463609.388000:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466890880 00000100:00100000:0.0:1788463609.388099:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:0.0:1788463609.388112:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14930:x1875339466890880:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463609.388391:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14930:x1875339466890880:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 280us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463609.388401:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 129 00000100:00100000:1.0:1788463609.411731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.416072:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891008 00000100:00100000:2.0:1788463609.416094:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891008 00000100:00100000:2.0:1788463609.416206:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:2.0:1788463609.416218:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14930:x1875339466891008:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463609.416765:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+10:14930:x1875339466891008:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 545us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.416786:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 130 00000100:00100000:2.0:1788463609.427428:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.427556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.428486:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891136 00000100:00100000:3.0:1788463609.428503:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891136 00000100:00100000:3.0:1788463609.428560:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891392 00000100:00100000:3.0:1788463609.428563:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891392 00000100:00100000:3.0:1788463609.428621:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463609.428631:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466891136:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788463609.428695:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:3.0:1788463609.428779:0:17058:0:(genops.c:1385:class_connect()) connect: client 11b4f176-a68a-42e0-807e-b5954986c863, cookie 0x841acb7f42a3ad61 00000004:00100000:3.0:1788463609.428814:0:17058:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788463609.429103:0:17058:0:(import.c:65:import_set_state_nolock()) ffff961787329000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463609.429218:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:2399:x1875339466891136:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 585us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.429228:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463609.429253:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463609.429259:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466891392:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788463609.429298:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:3.0:1788463609.429344:0:17058:0:(genops.c:1385:class_connect()) connect: client 11b4f176-a68a-42e0-807e-b5954986c863, cookie 0x841acb7f42a3ad68 00000004:00100000:3.0:1788463609.429363:0:17058:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788463609.429532:0:17058:0:(import.c:65:import_set_state_nolock()) ffff96178732e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463609.429562:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:2399:x1875339466891392:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 301us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.429569:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:1.0:1788463609.444011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463609.444060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463609.444183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.444749:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891264 00000100:00100000:3.0:1788463609.444764:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891264 00000100:00100000:3.0:1788463609.444867:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891648 00000100:00100000:3.0:1788463609.444881:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891648 00000100:00100000:3.0:1788463609.444895:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891520 00000100:00100000:3.0:1788463609.444898:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891520 00000100:00100000:3.0:1788463609.444919:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:3.0:1788463609.444931:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+7:0:x1875339466891264:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788463609.444977:0:17058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788463609.445093:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+7:0:x1875339466891264:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 163us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.445129:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:3.0:1788463609.445153:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:3.0:1788463609.445169:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466891648:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788463609.445183:0:17058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788463609.445208:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466891648:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 49us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.445216:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:3.0:1788463609.445229:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:3.0:1788463609.445236:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:0:x1875339466891520:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788463609.445248:0:17058:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788463609.445304:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+6:0:x1875339466891520:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 67us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.445311:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00080000:1.0:1788463609.447465:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463609.447478:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463609.460096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.460440:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891776 00000100:00100000:3.0:1788463609.461402:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891776 00000100:00100000:0.0:1788463609.462894:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:0.0:1788463609.462923:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466891776:12345-192.168.204.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788463609.463071:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466891776:12345-192.168.204.53@tcp:40:mount.lustre.0 Request processed in 163us (2990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463609.463080:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00010000:00010000:2.0:1788463609.476435:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463609.480649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.480723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.480765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463609.481616:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466891904 00000100:00100000:3.0:1788463609.481633:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466891904 00000100:00100000:3.0:1788463609.481703:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892032 00000100:00100000:3.0:1788463609.481708:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892032 00000100:00100000:3.0:1788463609.481735:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:3.0:1788463609.481746:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466891904:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463609.481822:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:3.0:1788463609.481877:0:18933:0:(genops.c:1385:class_connect()) connect: client 11b4f176-a68a-42e0-807e-b5954986c863, cookie 0x841acb7f42a3ad6f 00002000:00100000:3.0:1788463609.481896:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 11b4f176-a68a-42e0-807e-b5954986c863/ffff961785e71800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463609.481935:0:18933:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463609.482237:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463609.482282:0:18933:0:(import.c:65:import_set_state_nolock()) ffff961785e77800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463609.482384:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+6:2399:x1875339466891904:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 638us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463609.482394:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:3.0:1788463609.482419:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:3.0:1788463609.482424:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875339466892032:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463609.482444:0:18933:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp t0 exp 0000000000000000 cur 648 last 0 00000100:00100000:1.0:1788463609.483930:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892160 00000100:00100000:1.0:1788463609.483949:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892160 00000100:00100000:1.0:1788463609.484041:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463609.484053:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466892160:12345-192.168.204.53@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788463609.484157:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466892160:12345-192.168.204.53@tcp:900:mount.lustre.0 Request processed in 107us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463609.484177:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463609.490066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.493343:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892288 00000100:00100000:2.0:1788463609.493368:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892288 00000100:00100000:2.0:1788463609.493470:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:2.0:1788463609.493482:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466892288:12345-192.168.204.53@tcp:33:mount.lustre.0 00000020:00000080:0.0:1788463609.498409:0:18933:0:(genops.c:1385:class_connect()) connect: client 11b4f176-a68a-42e0-807e-b5954986c863, cookie 0x841acb7f42a3ad76 00002000:00100000:0.0:1788463609.498438:0:18933:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 11b4f176-a68a-42e0-807e-b5954986c863/ffff961785e73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463609.498467:0:18933:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463609.498758:0:18933:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463609.498815:0:18933:0:(import.c:65:import_set_state_nolock()) ffff961781702800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463609.498938:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+6:2399:x1875339466892032:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 16510us (18170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463609.498952:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000004:00080000:3.0:1788463609.511914:0:17059:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18260us 00000004:00200000:0.0:1788463609.540350:0:17059:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788463609.540545:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:14908:x1875339466892288:12345-192.168.204.53@tcp:33:mount.lustre.0 Request processed in 47056us (50485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463609.540589:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463609.804471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463609.804661:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892416 00000100:00100000:2.0:1788463609.804687:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892416 00000100:00100000:2.0:1788463609.804795:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:2.0:1788463609.804813:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:14953:x1875339466892416:12345-192.168.204.53@tcp:101:mkdir.0 00010000:00010000:2.0:1788463609.804848:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463609.804901:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ad7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b20 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805010:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805030:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805053:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463609.805181:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788463609.805187:0:17056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463609.805243:0:17056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805282:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27a00/0x841acb7f42a3ad7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b20 expref: 8 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805314:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b20 expref: 7 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463609.805339:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:2.0:1788463609.805344:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463609.805349:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26c00, rc 0) 00000100:00100000:2.0:1788463609.805446:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+7:14953:x1875339466892416:12345-192.168.204.53@tcp:101:mkdir.0 Request processed in 639us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463609.805455:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000040:00080000:2.0:1788463609.867734:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463610.500668:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463611.523859:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463612.095686:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.095788:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892544 00000100:00100000:1.0:1788463612.095800:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892544 00000100:00100000:1.0:1788463612.095895:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:1.0:1788463612.095906:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:15005:x1875339466892544:12345-192.168.204.53@tcp:41:lfs.0 00000004:00000024:1.0:1788463612.095953:0:18932:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463612.096054:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:15005:x1875339466892544:12345-192.168.204.53@tcp:41:lfs.0 Request processed in 150us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.096079:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00080000:3.0:1788463612.096206:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463612.101690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463612.101801:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892672 00000100:00100000:2.0:1788463612.101814:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892672 00000100:00100000:2.0:1788463612.101909:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:2.0:1788463612.101922:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892672:12345-192.168.204.53@tcp:41:lfs.0 00000004:00000024:2.0:1788463612.101968:0:17056:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788463612.102063:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892672:12345-192.168.204.53@tcp:41:lfs.0 Request processed in 144us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463612.102071:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00080000:3.0:1788463612.102479:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463612.106015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463612.106790:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892800 00000100:00100000:3.0:1788463612.106802:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892800 00000100:00100000:3.0:1788463612.106899:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:3.0:1788463612.106910:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892800:12345-192.168.204.53@tcp:13:lfs.0 00002000:00000024:3.0:1788463612.106945:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463612.107069:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892800:12345-192.168.204.53@tcp:13:lfs.0 Request processed in 159us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463612.107077:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00080000:1.0:1788463612.107943:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463612.112564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463612.112827:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466892928 00000100:00100000:3.0:1788463612.112839:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466892928 00000100:00100000:3.0:1788463612.112948:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:3.0:1788463612.112959:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892928:12345-192.168.204.53@tcp:13:lfs.0 00002000:00000024:3.0:1788463612.113032:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463612.113160:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:11b4f176-a68a-42e0-807e-b5954986c863+6:15005:x1875339466892928:12345-192.168.204.53@tcp:13:lfs.0 Request processed in 203us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463612.113168:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00080000:1.0:1788463612.113945:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463612.455229:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463612.455680:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893056 00000100:00100000:3.0:1788463612.455698:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893056 00000100:00100000:3.0:1788463612.455782:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:3.0:1788463612.455794:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+10:15039:x1875339466893056:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463612.455829:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463612.455862:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961882813800/0x841acb7f42a3ad8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b27 expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463612.455905:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961882813800/0x841acb7f42a3ad8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b27 expref: 11 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463612.455917:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961882813800/0x841acb7f42a3ad8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b27 expref: 11 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463612.455928:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882813800, rc 0) 00000100:00100000:3.0:1788463612.456021:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893056:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 230us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463612.456028:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 131 00000100:00100000:2.0:1788463612.461539:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.461735:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893184 00000100:00100000:0.0:1788463612.461749:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893184 00000100:00100000:0.0:1788463612.461836:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:0.0:1788463612.461849:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893184:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788463612.462068:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893184:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 221us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.462078:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 132 00000100:00100000:1.0:1788463612.467981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463612.468111:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893312 00000100:00100000:2.0:1788463612.468126:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893312 00000100:00100000:2.0:1788463612.468441:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:2.0:1788463612.468453:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893312:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788463612.469254:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893312:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 796us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463612.469266:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 133 00000100:00100000:3.0:1788463612.473212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.473316:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893440 00000100:00100000:0.0:1788463612.473331:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893440 00000100:00100000:0.0:1788463612.473405:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:0.0:1788463612.473418:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893440:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463612.479785:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893440:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 6301us (6529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.479833:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 134 00000100:00100000:3.0:1788463612.513616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463612.513799:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893568 00000100:00100000:2.0:1788463612.513824:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893568 00000100:00100000:2.0:1788463612.513905:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:2.0:1788463612.513919:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893568:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463612.514136:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893568:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 219us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463612.514146:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 135 00000100:00100000:2.0:1788463612.518923:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.519539:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893696 00000100:00100000:0.0:1788463612.519556:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893696 00000100:00100000:0.0:1788463612.519684:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:0.0:1788463612.519697:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893696:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463612.520125:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15044:x1875339466893696:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 428us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.520135:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 136 00000100:00100000:0.0:1788463612.535404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.535615:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893824 00000100:00100000:1.0:1788463612.535629:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893824 00000100:00100000:1.0:1788463612.535703:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:1.0:1788463612.535716:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+11:15039:x1875339466893824:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788463612.535739:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463612.535764:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d800/0x841acb7f42a3ad92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b58 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.535821:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d800/0x841acb7f42a3ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b58 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.535836:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d800/0x841acb7f42a3ad92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b58 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.535847:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d800, rc 0) 00000100:00100000:1.0:1788463612.535936:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+12:15039:x1875339466893824:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 222us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.535944:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 137 00000100:00100000:1.0:1788463612.541629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.541745:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466893952 00000100:00100000:0.0:1788463612.541759:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466893952 00000100:00100000:0.0:1788463612.541840:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:0.0:1788463612.541853:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:15039:x1875339466893952:12345-192.168.204.53@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788463612.541890:0:17049:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788463612.541920:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463612.541925:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788463612.541929:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788463612.541932:0:17049:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788463612.541935:0:17049:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788463612.544523:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:15039:x1875339466893952:12345-192.168.204.53@tcp:256:mount.lustre.0 Request processed in 2656us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.544543:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 138 00000100:00100000:2.0:1788463612.547731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00010000:00010000:1.0:1788463612.547975:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463612.548046:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894080 00000100:00100000:0.0:1788463612.548060:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894080 00000100:00100000:0.0:1788463612.548182:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:0.0:1788463612.548195:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+12:15039:x1875339466894080:12345-192.168.204.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463612.548217:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463612.548243:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b5f expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463612.548293:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 13 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463612.548308:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 13 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463612.548319:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4000, rc 0) 00000100:00100000:0.0:1788463612.548418:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15039:x1875339466894080:12345-192.168.204.53@tcp:101:mount.lustre.0 Request processed in 226us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.548426:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 139 00000100:00100000:3.0:1788463612.550880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.551543:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894208 00000100:00100000:1.0:1788463612.551602:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894208 00000100:00100000:1.0:1788463612.551665:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:1.0:1788463612.551677:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15039:x1875339466894208:12345-192.168.204.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788463612.551916:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15039:x1875339466894208:12345-192.168.204.53@tcp:501:mount.lustre.0 Request processed in 240us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.551926:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 140 00000100:00100000:3.0:1788463612.553927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.554057:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894336 00000100:00100000:1.0:1788463612.554070:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894336 00000100:00100000:1.0:1788463612.554138:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:1.0:1788463612.554150:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15039:x1875339466894336:12345-192.168.204.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788463612.554633:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15039:x1875339466894336:12345-192.168.204.53@tcp:503:mount.lustre.0 Request processed in 482us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.554642:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 141 00000100:00100000:3.0:1788463612.558099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.558289:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894464 00000100:00100000:1.0:1788463612.558302:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894464 00000100:00100000:1.0:1788463612.558361:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:1.0:1788463612.558373:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15047:x1875339466894464:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463612.558622:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15047:x1875339466894464:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 250us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.558631:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 142 00000100:00100000:3.0:1788463612.564120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.564284:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894592 00000100:00100000:1.0:1788463612.564298:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894592 00000100:00100000:1.0:1788463612.564368:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:1.0:1788463612.564381:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15047:x1875339466894592:12345-192.168.204.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463612.564617:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:15047:x1875339466894592:12345-192.168.204.53@tcp:502:llog_process_th.0 Request processed in 237us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.564634:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 143 00000100:00100000:3.0:1788463612.575199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463612.576435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463612.576620:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894720 00000100:00100000:2.0:1788463612.576634:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894720 00000100:00100000:2.0:1788463612.576696:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894976 00000100:00100000:2.0:1788463612.576699:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894976 00000100:00100000:2.0:1788463612.576732:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:2.0:1788463612.576743:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875339466894720:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788463612.576785:0:17058:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4@192.168.204.53@tcp t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:2.0:1788463612.576847:0:17058:0:(genops.c:1385:class_connect()) connect: client 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4, cookie 0x841acb7f42a3ada0 00000004:00100000:2.0:1788463612.576899:0:17058:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788463612.577030:0:17058:0:(import.c:65:import_set_state_nolock()) ffff9618bf57e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463612.577221:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463612.577228:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1875339466894976:12345-192.168.204.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788463612.577249:0:17057:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4@192.168.204.53@tcp t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1788463612.577292:0:17057:0:(genops.c:1385:class_connect()) connect: client 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4, cookie 0x841acb7f42a3ada7 00000004:00100000:0.0:1788463612.577306:0:17057:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788463612.577365:0:17057:0:(import.c:65:import_set_state_nolock()) ffff961781706000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463612.577414:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2399:x1875339466894976:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 184us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.577422:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:2.0:1788463612.578082:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2399:x1875339466894720:12345-192.168.204.53@tcp:38:mount.lustre.0 Request processed in 1336us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463612.578094:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:3.0:1788463612.581412:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463612.591160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.600891:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895104 00000100:00100000:0.0:1788463612.600916:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895104 00000100:00100000:0.0:1788463612.601009:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895232 00000100:00100000:0.0:1788463612.601013:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895232 00000100:00100000:0.0:1788463612.601054:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:0.0:1788463612.601067:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:0:x1875339466895104:12345-192.168.204.53@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788463612.601609:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463612.601616:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463612.601652:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:1.0:1788463612.601666:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895232:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788463612.601707:0:17056:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463612.601822:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895232:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 160us (10676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.601831:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:1.0:1788463612.601940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.603628:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466894848 00000100:00100000:1.0:1788463612.603647:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466894848 00000100:00100000:1.0:1788463612.603708:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:1.0:1788463612.603719:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:0:x1875339466894848:12345-192.168.204.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788463612.603756:0:17056:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788463612.603853:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:0:x1875339466894848:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 135us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.603861:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000004:00000024:0.0:1788463612.604012:0:17057:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463612.604053:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:0:x1875339466895104:12345-192.168.204.53@tcp:41:mount.lustre.0 Request processed in 2988us (22656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.604061:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:3.0:1788463612.604474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.605480:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895360 00000100:00100000:0.0:1788463612.605495:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895360 00000100:00100000:0.0:1788463612.605557:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:0.0:1788463612.605568:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895360:12345-192.168.204.53@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788463612.605701:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895360:12345-192.168.204.53@tcp:40:mount.lustre.0 Request processed in 134us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.605709:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463612.618191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.618388:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895744 00000100:00100000:1.0:1788463612.618404:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895744 00000100:00100000:1.0:1788463612.618485:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463612.618497:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895744:12345-192.168.204.53@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788463612.618649:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895744:12345-192.168.204.53@tcp:900:mount.lustre.0 Request processed in 153us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.618681:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:1.0:1788463612.632373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.632425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.632465:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463612.632618:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895488 00000100:00100000:0.0:1788463612.632632:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895488 00000100:00100000:0.0:1788463612.632684:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895616 00000100:00100000:0.0:1788463612.632688:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895616 00000100:00100000:0.0:1788463612.632712:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:0.0:1788463612.632723:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466895488:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788463612.632767:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4@192.168.204.53@tcp t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1788463612.632821:0:18564:0:(genops.c:1385:class_connect()) connect: client 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4, cookie 0x841acb7f42a3adae 00002000:00100000:0.0:1788463612.632838:0:18564:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4/ffff961781703800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463612.632855:0:18564:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463612.632969:0:18564:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788463612.633008:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961781701800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463612.633088:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2399:x1875339466895488:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 365us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.633096:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:0.0:1788463612.633130:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:0.0:1788463612.633136:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875339466895616:12345-192.168.204.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788463612.633152:0:18564:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4@192.168.204.53@tcp t0 exp 0000000000000000 cur 652 last 0 00000020:00000080:0.0:1788463612.633169:0:18564:0:(genops.c:1385:class_connect()) connect: client 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4, cookie 0x841acb7f42a3adb5 00002000:00100000:0.0:1788463612.633174:0:18564:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4/ffff961781700000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463612.633180:0:18564:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463612.633243:0:18564:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463612.633260:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961781702000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463612.633299:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2399:x1875339466895616:12345-192.168.204.53@tcp:8:mount.lustre.0 Request processed in 162us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463612.633307:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:3.0:1788463612.633633:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466895872 00000100:00100000:3.0:1788463612.633642:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466895872 00000100:00100000:3.0:1788463612.633680:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:3.0:1788463612.633688:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895872:12345-192.168.204.53@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788463612.633794:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788463612.633864:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15039:x1875339466895872:12345-192.168.204.53@tcp:33:mount.lustre.0 Request processed in 177us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463612.633871:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:3.0:1788463612.854437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463612.855162:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896000 00000100:00100000:1.0:1788463612.855176:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896000 00000100:00100000:1.0:1788463612.855255:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:1.0:1788463612.855557:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15070:x1875339466896000:12345-192.168.204.53@tcp:101:mkdir.0 00010000:00010000:1.0:1788463612.855614:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463612.855658:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3adbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b90 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855749:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855767:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855784:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463612.855863:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463612.855868:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463612.855895:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855927:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d200/0x841acb7f42a3adbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 8 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855976:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 7 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463612.855985:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:1.0:1788463612.855988:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463612.855993:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d000, rc 0) 00000100:00100000:1.0:1788463612.856087:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+7:15070:x1875339466896000:12345-192.168.204.53@tcp:101:mkdir.0 Request processed in 823us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463612.856103:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:2.0:1788463613.316645:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485864448:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.316745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.316831:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485864960:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.316855:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.316873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485865472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.316897:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.316915:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485865984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463613.316941:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.316968:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788463613.316974:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485864576:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.316996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.317012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485865088:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.317030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.317044:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485865600:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.317072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.317101:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.317127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.317145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485865216:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.317609:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864448 00000100:00100000:1.0:1788463613.317621:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864448 00000100:00100000:1.0:1788463613.317679:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864960 00000100:00100000:1.0:1788463613.317683:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864960 00000100:00100000:1.0:1788463613.317702:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463613.317713:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485864448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.317801:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485864448:12345-0@lo:400:kworker.0 Request processed in 80us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.317810:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463613.317831:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463613.317838:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485864960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.317869:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485864960:12345-0@lo:400:kworker.0 Request processed in 32us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.317875:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463613.317930:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485864448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.317942:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485864960:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.317993:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865472 00000100:00100000:1.0:1788463613.317997:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865472 00000100:00080000:1.0:1788463613.318023:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463613.318056:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865600 00000100:00100000:1.0:1788463613.318059:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865600 00000100:00100000:1.0:1788463613.318088:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463613.318094:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485865472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.318133:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485865472:12345-0@lo:400:kworker.0 Request processed in 40us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.318141:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463613.318152:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463613.318158:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485865600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.318871:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485864320:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.318935:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463613.318981:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485864832:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.319009:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463613.319025:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485865344:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.319047:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463613.319060:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485865856:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.319081:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463613.319128:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864576 00000100:00100000:0.0:1788463613.319134:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864576 00000100:00100000:3.0:1788463613.319468:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485866112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463613.319509:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463613.319600:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865984 00000100:00100000:3.0:1788463613.319605:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865984 00000100:00100000:3.0:1788463613.319633:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866112 00000100:00100000:3.0:1788463613.319636:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866112 00000100:00100000:3.0:1788463613.319656:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463613.319665:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485865984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463613.319690:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463613.319734:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875339485865984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463613.319741:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463613.319763:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463613.319786:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485866112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463613.319807:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463613.319836:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485866112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463613.319842:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463613.319893:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178727ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485866112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463613.319923:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864832 00000100:00100000:3.0:1788463613.319927:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864832 00000100:00100000:3.0:1788463613.319947:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865344 00000100:00100000:3.0:1788463613.319950:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865344 00000100:00100000:3.0:1788463613.319961:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865856 00000100:00100000:3.0:1788463613.319963:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865856 00000100:00100000:3.0:1788463613.320004:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463613.320011:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485864832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463613.320049:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875339485864832:12345-0@lo:400:kworker.0 Request processed in 39us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463613.320055:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463613.320066:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463613.320071:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485865344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463613.320097:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875339485865344:12345-0@lo:400:kworker.0 Request processed in 26us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463613.320103:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463613.320114:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463613.320120:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485865856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463613.320147:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875339485865856:12345-0@lo:400:kworker.0 Request processed in 28us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463613.320163:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463613.320557:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463613.321690:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875339485865600:12345-0@lo:400:kworker.0 Request processed in 3523us (4608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.321707:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788463613.321759:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463613.321767:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788463613.321832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188553dc00 x1875339485865600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463613.321849:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3648:1875339485865600:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.321869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485865472:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.321897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485865984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463613.321944:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864320 00000100:00100000:1.0:1788463613.321953:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864320 00000100:00100000:1.0:1788463613.322011:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463613.322020:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485864320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.322077:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3651:x1875339485864320:12345-0@lo:400:kworker.0 Request processed in 58us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.322084:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463613.322206:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485866368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463613.322244:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463613.322284:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:61537c78-f571-4169-84d6-9d8a2058e62c:3651:1875339485864320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.322300:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875339485864832:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.322316:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875339485865344:0@lo:400:kworker.0 00010000:00080000:1.0:1788463613.322330:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188553ea00 x1875339485865856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463629 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463613.322339:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3651:1875339485865856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463613.322360:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463613.322369:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485866240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463613.322396:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463613.322420:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866368 00000100:00100000:1.0:1788463613.322424:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866368 00000100:00100000:1.0:1788463613.322451:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866240 00000100:00100000:1.0:1788463613.322454:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866240 00000100:00100000:1.0:1788463613.322469:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463613.322475:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485866368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463613.322492:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463613.322530:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485866368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.322536:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463613.322556:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463613.322562:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485866240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463613.322572:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463613.322631:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485866240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463613.322637:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788463613.322652:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463613.322670:0:3651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788463613.322687:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fbece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485866240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463613.322698:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485866368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788463613.328279:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485865728:0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.328382:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.328506:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865728 00000100:00100000:2.0:1788463613.328516:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865728 00000100:00100000:2.0:1788463613.328648:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463613.328659:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485865728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463613.328726:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485865728:12345-0@lo:400:kworker.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463613.328734:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788463613.328758:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463613.328815:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485865728:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.330719:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865088 00000100:00100000:0.0:1788463613.330740:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865088 00000100:00100000:0.0:1788463613.330820:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485864704 00000100:00100000:0.0:1788463613.330824:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485864704 00000100:00100000:0.0:1788463613.330839:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485865216 00000100:00100000:0.0:1788463613.330842:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485865216 00000100:00100000:0.0:1788463613.330859:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463613.330871:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485864576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.330991:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485864576:12345-0@lo:400:kworker.0 Request processed in 122us (13993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.330998:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463613.331018:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463613.331040:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485865088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331073:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485865088:12345-0@lo:400:kworker.0 Request processed in 33us (14042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.331079:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463613.331105:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463613.331112:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485864704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331148:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485864704:12345-0@lo:400:kworker.0 Request processed in 38us (14021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.331154:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463613.331166:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463613.331172:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485865216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331212:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485865216:12345-0@lo:400:kworker.0 Request processed in 40us (14045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.331218:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463613.331345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485864576:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485865088:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331407:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485864704:0@lo:400:kworker.0 00000100:00100000:0.0:1788463613.331660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485865216:0@lo:400:kworker.0 00010000:00010000:2.0:1788463613.573262:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463613.828042:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463613.828090:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485866496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463613.828202:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463613.828219:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463613.828229:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485866624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463613.828265:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866496 00000100:00100000:0.0:1788463613.828273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463613.828275:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866496 00000100:00100000:0.0:1788463613.828307:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866624 00000100:00100000:0.0:1788463613.828311:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866624 00000100:00100000:0.0:1788463613.828346:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463613.828374:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485866624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463613.828440:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463613.828496:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485866624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.828504:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463613.828527:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463613.828533:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485866496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463613.828551:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788463613.828604:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485866496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463613.828609:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463613.835705:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485866496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463613.835842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485866624:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788463614.610172:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463614.917213:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788463615.373892:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:3.0:1788463615.373907:0:17789:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000001:00100000:1.0:1788463615.374333:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:1.0:1788463615.374340:0:18558:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000001:00100000:0.0:1788463615.374463:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:0.0:1788463615.374471:0:19378:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00000001:00100000:0.0:1788463615.375226:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a56831b-aebb-4a8f-ae8e-45964e8f9ab4 00000001:00100000:0.0:1788463615.375233:0:17036:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 11b4f176-a68a-42e0-807e-b5954986c863 00010000:00010000:2.0:1788463615.621165:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463616.645416:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463616.783986:0:19934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788463617.668423:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463617.773807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463617.773858:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463617.773986:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896256 00000100:00100000:1.0:1788463617.773998:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896256 00000100:00100000:1.0:1788463617.774088:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463617.774099:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2402:x1875339466896256:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463617.774176:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2402:x1875339466896256:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463617.774184:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463617.776181:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00080000:0.0:1788463617.776200:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463617.776308:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463617.776343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463617.776365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463617.776414:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896384 00000100:00100000:0.0:1788463617.776422:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896384 00000100:00100000:0.0:1788463617.776475:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896768 00000100:00100000:0.0:1788463617.776479:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896768 00000100:00100000:0.0:1788463617.776507:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:0.0:1788463617.776516:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466896384:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463617.776623:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466896384:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463617.776650:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:0.0:1788463617.776669:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:0.0:1788463617.776685:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2402:x1875339466896768:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463617.776732:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2402:x1875339466896768:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463617.776738:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00080000:0.0:1788463617.776892:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463617.776895:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463617.779145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463617.779500:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896128 00000100:00100000:2.0:1788463617.779512:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896128 00000100:00100000:2.0:1788463617.779585:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:2.0:1788463617.779596:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466896128:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463617.779682:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466896128:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 87us (5823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463617.779691:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 145 00000100:00100000:1.0:1788463617.782738:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896512 00000100:00100000:1.0:1788463617.782755:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896512 00000100:00100000:1.0:1788463617.782876:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896640 00000100:00100000:1.0:1788463617.782881:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896640 00000100:00100000:1.0:1788463617.782918:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:1.0:1788463617.782929:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2402:x1875339466896512:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463617.783033:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2402:x1875339466896512:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 105us (6860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463617.783042:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:1.0:1788463617.783072:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:1.0:1788463617.783079:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466896640:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463617.783109:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466896640:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 31us (6744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463617.783115:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00080000:2.0:1788463617.783655:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463617.783661:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463617.785375:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463617.785412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463617.785766:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897024 00000100:00100000:2.0:1788463617.785776:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897024 00000100:00100000:1.0:1788463617.785783:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897152 00000100:00100000:1.0:1788463617.785787:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897152 00000100:00100000:0.0:1788463617.785842:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466896896 00000100:00100000:2.0:1788463617.785843:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:0.0:1788463617.785846:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466896896 00000100:00100000:2.0:1788463617.785853:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2402:x1875339466897024:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463617.785921:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2402:x1875339466897024:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 69us (6786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463617.785929:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:1.0:1788463617.790284:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463617.790301:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466897152:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463617.790391:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466897152:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 94us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463617.790399:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:0.0:1788463617.793198:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:0.0:1788463617.793215:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466896896:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463617.793308:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466896896:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 95us (7941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463617.793316:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00080000:3.0:1788463617.806408:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463617.806421:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463617.806424:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463618.436349:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485866752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463618.436431:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436504:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485867264:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436533:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436553:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485867776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436598:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436618:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485868288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436642:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436682:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788463618.436689:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485866880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463618.436722:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436740:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485867392:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436762:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436785:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485867904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436803:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485868416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436840:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436877:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485867008:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485867520:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436953:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.436972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485868032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.436991:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.437010:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437029:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.437041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788463618.437046:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485867136:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437120:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.437141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485867648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.437177:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.437235:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866752 00000100:00100000:1.0:1788463618.437243:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866752 00000100:00100000:1.0:1788463618.437293:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485866880 00000100:00100000:1.0:1788463618.437296:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485866880 00000100:00100000:1.0:1788463618.437332:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463618.437342:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485866752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788463618.437378:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463618.437423:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485866752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437430:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463618.437449:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463618.437454:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485866880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463618.437468:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788463618.437492:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485866880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437498:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463618.437515:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867264 00000100:00100000:1.0:1788463618.437519:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867264 00000100:00100000:1.0:1788463618.437536:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867776 00000100:00100000:1.0:1788463618.437539:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867776 00000100:00100000:1.0:1788463618.437550:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867392 00000100:00100000:1.0:1788463618.437552:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867392 00000100:00100000:1.0:1788463618.437563:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867904 00000100:00100000:1.0:1788463618.437565:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867904 00000100:00100000:1.0:1788463618.437609:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463618.437616:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485867264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437649:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485867264:12345-0@lo:400:kworker.0 Request processed in 34us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437655:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463618.437675:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463618.437681:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485867776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437733:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485867776:12345-0@lo:400:kworker.0 Request processed in 52us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437739:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463618.437752:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463618.437757:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485867392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437783:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485867392:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437788:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463618.437799:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463618.437805:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485867904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.437829:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485867904:12345-0@lo:400:kworker.0 Request processed in 25us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.437835:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463618.437857:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868288 00000100:00100000:1.0:1788463618.437861:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868288 00000100:00100000:1.0:1788463618.437881:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868416 00000100:00100000:1.0:1788463618.437883:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868416 00000100:00100000:1.0:1788463618.437895:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867520 00000100:00100000:1.0:1788463618.437898:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867520 00000100:00100000:1.0:1788463618.437907:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868032 00000100:00100000:1.0:1788463618.437909:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868032 00000100:00100000:1.0:1788463618.437917:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868544 00000100:00100000:1.0:1788463618.437919:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868544 00000100:00100000:1.0:1788463618.437928:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868160 00000100:00100000:1.0:1788463618.437930:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868160 00000100:00100000:1.0:1788463618.437958:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463618.437964:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485868288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438000:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485868288:12345-0@lo:400:kworker.0 Request processed in 37us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438006:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463618.438019:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463618.438025:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485868416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438051:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485868416:12345-0@lo:400:kworker.0 Request processed in 26us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438057:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463618.438067:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463618.438072:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485867520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438103:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485867520:12345-0@lo:400:kworker.0 Request processed in 31us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438108:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788463618.438120:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463618.438125:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438150:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485868032:12345-0@lo:400:kworker.0 Request processed in 25us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438155:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463618.438167:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463618.438172:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438197:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485868544:12345-0@lo:400:kworker.0 Request processed in 25us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438202:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463618.438214:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463618.438219:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438255:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485868160:12345-0@lo:400:kworker.0 Request processed in 35us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438261:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463618.438294:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867008 00000100:00100000:1.0:1788463618.438298:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867008 00000100:00100000:1.0:1788463618.438326:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463618.438333:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485867008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438363:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485867008:12345-0@lo:400:kworker.0 Request processed in 31us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438369:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463618.438402:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867136 00000100:00100000:1.0:1788463618.438406:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867136 00000100:00100000:1.0:1788463618.438436:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485867648 00000100:00100000:1.0:1788463618.438439:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485867648 00000100:00100000:1.0:1788463618.438450:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463618.438455:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485867136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438483:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485867136:12345-0@lo:400:kworker.0 Request processed in 28us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438489:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463618.438499:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463618.438505:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485867648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438528:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485867648:12345-0@lo:400:kworker.0 Request processed in 24us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.438533:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788463618.438551:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463618.438555:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788463618.438557:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463618.438566:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463618.438622:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485867136:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485867648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485868160:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485867008:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438657:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485867520:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438665:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485868032:0@lo:400:kworker.0 00010000:00080000:1.0:1788463618.438679:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b46d80 x1875339485868544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463618.438688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485868544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485866880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463618.438759:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485867392:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438769:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485867904:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438779:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485868416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438790:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485866752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463618.438798:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485867264:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.438807:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485867776:0@lo:400:kworker.0 00010000:00080000:1.0:1788463618.438819:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fba8000 x1875339485868288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463618.438828:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485868288:0@lo:400:kworker.0 00000100:00100000:1.0:1788463618.442644:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463618.442672:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485868800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463618.442757:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.442808:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485868672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463618.442832:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463618.442875:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868800 00000100:00100000:1.0:1788463618.442883:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868800 00000100:00100000:1.0:1788463618.442924:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868672 00000100:00100000:1.0:1788463618.442927:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868672 00000100:00100000:1.0:1788463618.442943:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463618.442951:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485868800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463618.442974:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463618.443019:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485868800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.443025:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463618.443043:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463618.443050:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485868672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788463618.443060:0:18565:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788463618.443091:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485868672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463618.443097:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463618.443137:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485868672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463618.443166:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485868800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788463618.700329:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463618.948244:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485868928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463618.948319:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463618.948377:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485868928 00000100:00100000:0.0:1788463618.948385:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485868928 00000100:00100000:0.0:1788463618.948432:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463618.948441:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485868928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463618.948496:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463618.948544:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485868928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463618.948551:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463618.948628:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485868928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463618.953941:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485869056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788463618.954023:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463618.954129:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869056 00000100:00100000:0.0:1788463618.954154:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869056 00000100:00100000:0.0:1788463618.954213:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463618.954223:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485869056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788463618.954259:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788463618.954321:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485869056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463618.954329:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463618.954911:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485869056:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788463619.076293:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788463619.715792:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463620.739819:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788463621.751334:0:20082:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6a4d34e0 20000000:00000080:1.0:1788463621.751351:0:20082:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9618bf5b8000 uarg=0000000000000000 20000000:01000000:1.0:1788463621.751392:0:20082:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788463621.751397:0:20082:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788463621.751401:0:20082:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788463621.751746:0:20083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788463621.752012:0:20082:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788463621.761745:0:20082:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788463621.761881:0:20082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761902:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761911:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761919:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761927:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761946:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761954:0:20082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.761973:0:20082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.762326:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 12 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.762341:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 12 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.762357:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869184:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463621.762464:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.762473:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 12 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.762482:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869312:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463621.762513:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.762522:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 23 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.762610:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869440:0@lo:104: 00000100:00100000:0.0:1788463621.762660:0:20082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463621.762704:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.762723:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 23 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.762732:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869568:0@lo:104: 00000100:00100000:3.0:1788463621.762741:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869440 00000100:00100000:3.0:1788463621.762750:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869440 00000100:00100000:0.0:1788463621.762754:0:20082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463621.762785:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463621.762793:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869568 00010000:00010000:0.0:1788463621.762793:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 23 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463621.762796:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869568 00000100:00100000:0.0:1788463621.762801:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869696:0@lo:104: 00000100:00100000:3.0:1788463621.762809:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463621.762817:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:20082:x1875339485869440:12345-0@lo:104: 00000100:00100000:0.0:1788463621.762818:0:20082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463621.762835:0:20082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 23 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.762849:0:18209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.762900:0:18209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463621.762906:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:20082:x1875339485869440:12345-0@lo:104: Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.762919:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463621.762947:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869696 00000100:00100000:3.0:1788463621.762949:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463621.762951:0:17040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869696 00000100:00100000:3.0:1788463621.762955:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:20082:x1875339485869568:12345-0@lo:104: 00010000:00010000:3.0:1788463621.762963:0:18209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463621.762968:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463621.762973:0:17040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61537c78-f571-4169-84d6-9d8a2058e62c+4:20082:x1875339485869696:12345-0@lo:104: 00010000:00010000:1.0:1788463621.762981:0:17040:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.762995:0:18209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463621.763000:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+4:20082:x1875339485869568:12345-0@lo:104: Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.763006:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788463621.763178:0:17040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788463621.763184:0:17040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:61537c78-f571-4169-84d6-9d8a2058e62c+3:20082:x1875339485869696:12345-0@lo:104: Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463621.763190:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788463621.763210:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463621.763216:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763223:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27400 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463621.763228:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763236:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463621.763243:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463621.763255:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463621.763293:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763300:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463621.763322:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763330:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e27400/0x841acb7f42a3ac03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3ac0a expref: -99 pid: 19377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763342:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463621.763345:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763350:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfe00 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463621.763353:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763359:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463621.763365:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463621.763370:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463621.763392:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763399:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463621.763420:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763427:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bdfe00/0x841acb7f42a3aaa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aaac expref: -99 pid: 18557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763438:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463621.763441:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763447:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde200 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463621.763450:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763457:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463621.763463:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463621.763467:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463621.763492:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763498:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463621.763503:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763510:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff961786bde200/0x841acb7f42a3aa66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa6d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.763540:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463621.763542:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463621.763544:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463621.763556:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485869952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463621.763612:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463621.763660:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463621.763666:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869952 00000100:00100000:3.0:1788463621.763670:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869952 00000100:00100000:1.0:1788463621.763681:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463621.763685:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 24 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463621.763699:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463621.763703:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870080 00000100:00100000:3.0:1788463621.763705:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870080 00000100:00100000:1.0:1788463621.763705:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463621.763715:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 25 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463621.763722:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463621.763725:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870208 00000100:00100000:3.0:1788463621.763727:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870208 00010000:00010000:3.0:1788463621.763737:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 26 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463621.763748:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463621.763754:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+26:3649:x1875339485869952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463621.763769:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463621.763774:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 26 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.763789:0:20082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 26 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.763800:0:20082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869824:0@lo:104: 00000100:00100000:0.0:1788463621.763825:0:20082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463621.764260:0:20082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618bf56c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463621.764292:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869440:0@lo:104: 00000100:00100000:0.0:1788463621.764303:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869568:0@lo:104: 00000100:00100000:0.0:1788463621.764310:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869696:0@lo:104: 00010000:00010000:2.0:1788463621.764390:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463621.764423:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 26 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.764441:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961882812400/0x841acb7f42a3ac0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3ac03 expref: 26 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463621.764447:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788463621.764457:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463621.764457:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+25:3650:x1875339485870080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463621.764467:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463621.764473:0:17043:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 25 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.764482:0:17043:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 25 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.764492:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3aaac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aaa5 expref: 25 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.764500:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463621.764507:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61537c78-f571-4169-84d6-9d8a2058e62c+24:3649:x1875339485869952:12345-0@lo:103:ldlm_bl.0 Request processed in 753us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.764514:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463621.764533:0:17041:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788463621.764540:0:17041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788463621.764559:0:17042:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788463621.764566:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463621.764599:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+23:3650:x1875339485870208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463621.764603:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:61537c78-f571-4169-84d6-9d8a2058e62c+23:3650:x1875339485870080:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463621.764609:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788463621.764623:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463621.764643:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 22 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.764653:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 22 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.764662:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0dc00/0x841acb7f42a3aa6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aa66 expref: 22 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.764672:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463621.764699:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3650:x1875339485870208:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.764706:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463621.764872:0:18209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485869824 00000100:00100000:3.0:1788463621.764878:0:18209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485869824 00000100:00100000:3.0:1788463621.764906:0:18209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463621.764912:0:18209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+3:20082:x1875339485869824:12345-0@lo:104: 00010000:00010000:3.0:1788463621.764923:0:18209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.764959:0:18209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463621.764965:0:18209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:61537c78-f571-4169-84d6-9d8a2058e62c+3:20082:x1875339485869824:12345-0@lo:104: Request processed in 53us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.764970:0:18209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788463621.765079:0:17044:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463621.765086:0:17044:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765094:0:17044:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26800 already unused, calling callback (ffffffffc1363c20) 10000000:00010000:1.0:1788463621.765098:0:17044:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765106:0:17044:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463621.765114:0:17044:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463621.765119:0:17044:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463621.765390:0:17044:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765398:0:17044:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463621.765415:0:17044:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765422:0:17044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.153@tcp lock: ffff9618c1e26800/0x841acb7f42a3aa58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x841acb7f42a3aa5f expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765437:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463621.765439:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463621.765440:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463621.765452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485870336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463621.765487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463621.765658:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463621.765661:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870336 00000100:00100000:1.0:1788463621.765666:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870336 00000100:00100000:2.0:1788463621.765683:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463621.765685:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 21 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463621.765692:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463621.765705:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463621.765712:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3648:x1875339485870336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463621.765720:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463621.765725:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 21 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765734:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 21 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463621.765747:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463621.765787:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61537c78-f571-4169-84d6-9d8a2058e62c+21:3648:x1875339485870336:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463621.765793:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463621.766367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:61537c78-f571-4169-84d6-9d8a2058e62c:3649:1875339485869952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463621.766410:0:20082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff961787d0ce00/0x841acb7f42a3aa5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x841acb7f42a3aa58 expref: 20 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.766442:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869824:0@lo:104: 00000100:00100000:2.0:1788463621.766511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485870336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463621.774516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463621.774642:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897280 00000100:00100000:1.0:1788463621.774650:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463621.774652:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897280 00010000:00010000:3.0:1788463621.774701:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 13 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463621.774746:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897408 00000100:00100000:3.0:1788463621.774749:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897408 00010000:00010000:3.0:1788463621.774792:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 14 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.774832:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869184:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463621.775196:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:3.0:1788463621.775207:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+14:2400:x1875339466897280:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463621.775223:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463621.775229:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 14 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.775252:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 14 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.775287:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f4000/0x841acb7f42a3ad99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b5f expref: 14 pid: 17051 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463621.775302:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463621.776318:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:2.0:1788463621.776333:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2401:x1875339466897408:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463621.776345:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463621.776362:0:17043:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 13 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776373:0:17043:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 13 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776388:0:17043:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776396:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776419:0:17043:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776426:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776434:0:17043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776440:0:17043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776446:0:17043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5c00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:2.0:1788463621.776452:0:17043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776461:0:17043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776469:0:17043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463621.776487:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463621.776721:0:20082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ad5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476aef expref: 13 pid: 17050 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463621.776734:0:20082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20082:1875339485869312:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463621.776754:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:2400:x1875339466897280:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 1548us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463621.776763:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00010000:00010000:0.0:1788463621.776773:0:20082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.776782:0:20082:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.776787:0:20082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463621.776793:0:20082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96188f6f5c00/0x841acb7f42a3adca lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463621.783531:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c701ce0f-5243-483e-b03d-f799276c6ff2+11:2401:x1875339466897408:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 7190us (8866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463621.783549:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00010000:00010000:1.0:1788463622.787983:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463622.893269:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463622.893340:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897536 00000100:00100000:2.0:1788463622.893353:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897536 00000100:00100000:2.0:1788463622.893414:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:2.0:1788463622.893424:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+11:14923:x1875339466897536:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463622.893441:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463622.893464:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e27a00/0x841acb7f42a3add1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b97 expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.893494:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27a00/0x841acb7f42a3add1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b97 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.893506:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e27a00/0x841acb7f42a3add1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b97 expref: 12 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.893516:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27a00, rc 0) 00000100:00100000:2.0:1788463622.893621:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466897536:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 188us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.893627:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 147 00000100:00100000:3.0:1788463622.914500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914699:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914744:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914759:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914810:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.914876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463622.915010:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898048 00000100:00100000:2.0:1788463622.915021:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898048 00000100:00100000:2.0:1788463622.915090:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898560 00000100:00100000:2.0:1788463622.915094:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898560 00000100:00100000:2.0:1788463622.915111:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898176 00000100:00100000:2.0:1788463622.915113:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898176 00000100:00100000:2.0:1788463622.915124:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898688 00000100:00100000:2.0:1788463622.915126:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898688 00000100:00100000:2.0:1788463622.915143:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:2.0:1788463622.915169:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466898048:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463622.915181:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897792 00000100:00100000:0.0:1788463622.915185:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897792 00000100:00100000:0.0:1788463622.915209:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898304 00000100:00100000:0.0:1788463622.915211:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898304 00000100:00100000:0.0:1788463622.915222:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897920 00000100:00100000:0.0:1788463622.915224:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897920 00000100:00100000:0.0:1788463622.915235:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898432 00000100:00100000:0.0:1788463622.915237:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898432 00000100:00100000:0.0:1788463622.915250:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:0.0:1788463622.915256:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2400:x1875339466897792:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463622.915264:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466898048:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 100us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.915271:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:2.0:1788463622.915287:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:2.0:1788463622.915293:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898560:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463622.915294:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:2400:x1875339466897792:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 39us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.915301:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:2.0:1788463622.915312:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898560:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.915315:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:2.0:1788463622.915318:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:0.0:1788463622.915321:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2401:x1875339466898304:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463622.915327:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:2.0:1788463622.915333:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466898176:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463622.915339:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2401:x1875339466898304:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.915346:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:2.0:1788463622.915351:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466898176:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 19us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.915357:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:0.0:1788463622.915357:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:0.0:1788463622.915363:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466897920:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463622.915366:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:2.0:1788463622.915371:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898688:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463622.915383:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466897920:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.915387:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898688:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 17us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.915389:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463622.915393:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:0.0:1788463622.915398:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:0.0:1788463622.915404:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898432:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463622.915424:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466898432:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 20us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.915431:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:1.0:1788463622.918166:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466897664 00000100:00100000:1.0:1788463622.918180:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466897664 00000100:00100000:1.0:1788463622.918246:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00100000:1.0:1788463622.918257:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:2400:x1875339466897664:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463622.918408:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:2400:x1875339466897664:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 152us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463622.918417:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 148 00000100:00080000:3.0:1788463622.919319:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463622.919326:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463622.919329:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463622.919332:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463622.929009:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463622.929105:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898816 00000100:00100000:1.0:1788463622.929119:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898816 00000100:00100000:1.0:1788463622.929183:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00100000:1.0:1788463622.929194:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466898816:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463622.929363:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466898816:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 169us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463622.929371:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 149 00000100:00100000:1.0:1788463622.935300:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463622.935426:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466898944 00000100:00100000:2.0:1788463622.935437:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466898944 00000100:00100000:2.0:1788463622.935500:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:2.0:1788463622.935511:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466898944:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463622.935720:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466898944:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 210us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.935728:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 150 00000100:00100000:3.0:1788463622.959356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463622.964724:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899072 00000100:00100000:2.0:1788463622.964743:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899072 00000100:00100000:2.0:1788463622.964804:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:2.0:1788463622.964817:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+12:14923:x1875339466899072:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463622.964834:0:17049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463622.964865:0:17049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3add8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476b9e expref: -99 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.964894:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3add8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b9e expref: 13 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.964906:0:17049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26400/0x841acb7f42a3add8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b9e expref: 13 pid: 17049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463622.964915:0:17049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26400, rc 0) 00000100:00100000:2.0:1788463622.964986:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:14923:x1875339466899072:12345-192.168.204.53@tcp:101:ll_cfg_requeue.0 Request processed in 171us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463622.964993:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 151 00000100:00100000:3.0:1788463622.971115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463622.971224:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899200 00000100:00100000:0.0:1788463622.971234:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899200 00000100:00100000:0.0:1788463622.971291:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:0.0:1788463622.971302:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:14923:x1875339466899200:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463622.971474:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:14923:x1875339466899200:12345-192.168.204.53@tcp:501:ll_cfg_requeue.0 Request processed in 174us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463622.971498:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 152 00000100:00100000:2.0:1788463622.978908:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463622.978971:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899328 00000100:00100000:3.0:1788463622.978981:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899328 00000100:00100000:3.0:1788463622.979043:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:3.0:1788463622.979054:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:14923:x1875339466899328:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463622.979203:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c701ce0f-5243-483e-b03d-f799276c6ff2+13:14923:x1875339466899328:12345-192.168.204.53@tcp:503:ll_cfg_requeue.0 Request processed in 150us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463622.979212:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 153 00000100:00100000:1.0:1788463623.557639:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485870464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463623.557746:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.558531:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485870976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.558617:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.558650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485871488:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.558678:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.558706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485872000:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.558728:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463623.558930:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870976 00000100:00100000:0.0:1788463623.558939:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870976 00000100:00100000:3.0:1788463623.558980:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871488 00000100:00100000:3.0:1788463623.558987:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871488 00000100:00100000:0.0:1788463623.559002:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463623.559014:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618adecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485870976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463623.559028:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463623.559048:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485871488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463623.559097:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485871488:12345-0@lo:400:kworker.0 Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463623.559104:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788463623.559125:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463623.559261:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485872512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463623.559294:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559347:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485870976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559361:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485871488:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559394:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788463623.559401:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485870848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559428:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559451:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485871360:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559487:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559507:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485871872:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559546:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485872384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788463623.559562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559622:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485870592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463623.559645:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559657:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485871104:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559675:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559689:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485871616:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559706:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.559720:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485872128:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.559740:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463623.559962:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618adecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485870976:12345-0@lo:400:kworker.0 Request processed in 59us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.559971:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463623.560338:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871104 00000100:00100000:0.0:1788463623.560345:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871104 00000100:00100000:0.0:1788463623.560376:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871616 00000100:00100000:0.0:1788463623.560378:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871616 00000100:00100000:0.0:1788463623.560393:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463623.560401:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485871104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463623.560444:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485871104:12345-0@lo:400:kworker.0 Request processed in 44us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.560450:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463623.560475:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463623.560483:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485871616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463623.560510:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485871616:12345-0@lo:400:kworker.0 Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.560516:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463623.561044:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485871104:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.561056:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485871616:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.561195:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788463623.561209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870720:0@lo:400:kworker.0 00000100:00100000:3.0:1788463623.561238:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870464 00000100:00100000:3.0:1788463623.561244:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870464 00000100:00100000:1.0:1788463623.561250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.561288:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872512 00000100:00100000:3.0:1788463623.561293:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872512 00000100:00100000:1.0:1788463623.561296:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485871232:0@lo:400:kworker.0 00000100:00100000:3.0:1788463623.561307:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872384 00000100:00100000:3.0:1788463623.561313:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872384 00000100:00100000:3.0:1788463623.561329:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870592 00000100:00100000:3.0:1788463623.561333:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870592 00000100:00100000:1.0:1788463623.561348:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.561351:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463623.561362:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485870464:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463623.561376:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485871744:0@lo:400:kworker.0 00002000:00000024:3.0:1788463623.561391:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788463623.561401:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.561414:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485872256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.561448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.561449:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485870464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463623.561459:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463623.561475:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463623.561481:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485872512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463623.561500:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788463623.561529:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485872512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463623.561542:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463623.561559:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463623.561568:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485872384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788463623.561615:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463623.561647:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485872384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463623.561660:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463623.561676:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463623.561686:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485870592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463623.561700:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788463623.561729:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485870592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463623.561735:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788463623.561756:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463623.561794:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485872384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463623.561808:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485872512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463623.561820:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485870464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463623.561941:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872000 00000100:00100000:1.0:1788463623.561947:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872000 00000100:00100000:1.0:1788463623.561988:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871872 00000100:00100000:1.0:1788463623.561992:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871872 00000100:00100000:1.0:1788463623.562005:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872128 00000100:00100000:1.0:1788463623.562008:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872128 00000100:00100000:1.0:1788463623.562019:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871232 00000100:00100000:1.0:1788463623.562021:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871232 00000100:00100000:1.0:1788463623.562032:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871744 00000100:00100000:1.0:1788463623.562035:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871744 00000100:00100000:1.0:1788463623.562044:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872256 00000100:00100000:1.0:1788463623.562047:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872256 00000100:00100000:1.0:1788463623.562060:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463623.562066:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485872000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563156:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875339485872000:12345-0@lo:400:kworker.0 Request processed in 1086us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563168:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788463623.563183:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463623.563190:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463623.563200:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788463623.563211:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485871872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563242:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875339485871872:12345-0@lo:400:kworker.0 Request processed in 35us (3711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563248:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788463623.563261:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463623.563278:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485872128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563309:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485872128:12345-0@lo:400:kworker.0 Request processed in 32us (3568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563315:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463623.563327:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788463623.563334:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485871232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563359:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485871232:12345-0@lo:400:kworker.0 Request processed in 26us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563364:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788463623.563375:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788463623.563381:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485871744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563407:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875339485871744:12345-0@lo:400:kworker.0 Request processed in 26us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563413:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788463623.563424:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463623.563431:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485872256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563457:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875339485872256:12345-0@lo:400:kworker.0 Request processed in 27us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563462:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463623.563491:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870848 00000100:00100000:1.0:1788463623.563498:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870848 00000100:00100000:1.0:1788463623.563609:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485871360 00000100:00100000:1.0:1788463623.563612:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485871360 00000100:00100000:1.0:1788463623.563628:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788463623.563634:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485870848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563668:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485870848:12345-0@lo:400:kworker.0 Request processed in 34us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563681:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788463623.563694:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463623.563700:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485871360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563730:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485871360:12345-0@lo:400:kworker.0 Request processed in 30us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563736:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463623.563769:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485870720 00000100:00100000:1.0:1788463623.563774:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485870720 00000100:00100000:1.0:1788463623.563800:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463623.563808:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+20:3650:x1875339485870720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563842:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+20:3650:x1875339485870720:12345-0@lo:400:kworker.0 Request processed in 36us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.563849:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463623.563903:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:61537c78-f571-4169-84d6-9d8a2058e62c:3650:1875339485870720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563922:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485871232:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563940:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875339485871744:0@lo:400:kworker.0 00010000:00080000:1.0:1788463623.563958:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d110000 x1875339485872256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463623.563970:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d110000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3650:1875339485872256:0@lo:400:kworker.0 00000100:00100000:1.0:1788463623.563993:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485870592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463623.564006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485872128:0@lo:400:kworker.0 00000100:00100000:0.0:1788463623.566291:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485870848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463623.566310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485871360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463623.566325:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3649:1875339485871872:0@lo:400:kworker.0 00010000:00080000:0.0:1788463623.566360:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188d112d80 x1875339485872000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463623.566371:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188d112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3649:1875339485872000:0@lo:400:kworker.0 10000000:01000000:3.0:1788463623.619723:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463623.619731:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9617873bb000 from 13 10000000:01000000:3.0:1788463623.619737:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463623.619803:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.619829:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.619841:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463623.619872:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.619965:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.620017:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463623.620435:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872640 00000100:00100000:1.0:1788463623.620456:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872640 00000100:00100000:1.0:1788463623.620525:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788463623.620535:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+20:17054:x1875339485872640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463623.620552:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463623.620568:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff961787d0d200/0x841acb7f42a3ade6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3addf expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.620648:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff961787d0d200/0x841acb7f42a3ade6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3addf expref: 21 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.620662:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff961787d0d200/0x841acb7f42a3ade6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3addf expref: 21 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.620671:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d200, rc 0) 00000100:00100000:1.0:1788463623.620733:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617810f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485872640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.620741:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788463623.622845:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463623.622879:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.622902:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463623.623006:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.623812:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.623856:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463623.623973:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872768 00000100:00100000:0.0:1788463623.623981:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872768 00000100:00100000:0.0:1788463623.624049:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463623.624067:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485872768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463623.624217:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485872768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.624225:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788463623.624615:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.624658:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.624705:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.624735:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463623.624800:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485872896 00000100:00100000:2.0:1788463623.624805:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485872896 00000100:00100000:2.0:1788463623.624828:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788463623.624834:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485872896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463623.624921:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485872896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463623.624935:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788463623.625364:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485872896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788463623.626552:0:20152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788463623.626824:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788463623.626845:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463623.626856:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.626868:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961882813a00/0x841acb7f42a3addf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ade6 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463623.626880:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463623.626892:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188cf2e800 from 13 10000000:01000000:1.0:1788463623.626896:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463623.626936:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.626968:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.626979:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463623.627001:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463623.627316:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.627367:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961891652d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463623.627448:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873024 00000100:00100000:0.0:1788463623.627455:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873024 00000100:00100000:0.0:1788463623.627503:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463623.627512:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+21:17054:x1875339485873024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463623.627524:0:17050:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463623.627536:0:17050:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a3adf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3aded expref: -99 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463623.627558:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a3adf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3aded expref: 22 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463623.627569:0:17050:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96188f6f5e00/0x841acb7f42a3adf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3aded expref: 22 pid: 17050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463623.627623:0:17050:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5e00, rc 0) 00000100:00100000:0.0:1788463623.627665:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.627683:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788463623.627901:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463623.627918:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.627926:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463623.627992:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.628020:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.628388:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463623.628442:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873152 00000100:00100000:0.0:1788463623.628448:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873152 00000100:00100000:0.0:1788463623.628484:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788463623.628492:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463623.628646:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.628653:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788463623.628792:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.628823:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.628866:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.628899:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463623.629067:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873280 00000100:00100000:1.0:1788463623.629072:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873280 00000100:00100000:1.0:1788463623.629095:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463623.629102:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463623.629187:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463623.629194:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788463623.629409:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788463623.630381:0:20153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788463623.630733:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788463623.630757:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463623.630767:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.630777:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0c400/0x841acb7f42a3aded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3adf4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463623.630788:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463623.630791:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96188cec8000 from 13 10000000:01000000:1.0:1788463623.630793:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463623.630839:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.630846:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.630855:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463623.630875:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463623.630929:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.630982:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463623.631162:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873408 00000100:00100000:2.0:1788463623.631170:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873408 00000100:00100000:2.0:1788463623.631218:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788463623.631227:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+22:17054:x1875339485873408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463623.631240:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463623.631253:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3ae02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3adfb expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.631276:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3ae02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3adfb expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.631287:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e27800/0x841acb7f42a3ae02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3adfb expref: 23 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.631295:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27800, rc 0) 00000100:00100000:2.0:1788463623.631337:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463623.631344:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463623.631916:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463623.631936:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.631946:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463623.632017:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.632079:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.632111:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463623.633277:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873536 00000100:00100000:0.0:1788463623.633287:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873536 00000100:00100000:0.0:1788463623.633343:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788463623.633353:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463623.633494:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.633501:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788463623.635373:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.635440:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.635517:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.635752:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463623.636191:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873664 00000100:00100000:0.0:1788463623.636199:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873664 00000100:00100000:0.0:1788463623.636247:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788463623.636256:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463623.636384:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.636392:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788463623.636454:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463623.637731:0:20154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788463623.637926:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788463623.637950:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463623.637962:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.637973:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0dc00/0x841acb7f42a3adfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463623.637984:0:17054:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463623.637986:0:17054:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff96189154b000 from 13 10000000:01000000:1.0:1788463623.637989:0:17054:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463623.638023:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.638032:0:17054:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463623.638055:0:17054:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463623.638075:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463623.638128:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463623.638202:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463623.638261:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873792 00000100:00100000:2.0:1788463623.638294:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873792 00000100:00100000:2.0:1788463623.638375:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463623.638385:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+23:17054:x1875339485873792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463623.638397:0:17051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463623.638412:0:17051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ae10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x841acb7f42a3ae09 expref: -99 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.638447:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ae10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x841acb7f42a3ae09 expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.638460:0:17051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9618c1e26000/0x841acb7f42a3ae10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x841acb7f42a3ae09 expref: 24 pid: 17051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.638469:0:17051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26000, rc 0) 00000100:00100000:2.0:1788463623.638525:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485873792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463623.638531:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788463623.638658:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463623.638675:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.638684:0:17054:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463623.638745:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.638773:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.639101:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463623.639174:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485873920 00000100:00100000:1.0:1788463623.639180:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485873920 00000100:00100000:0.0:1788463623.639312:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788463623.639320:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485873920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463623.639454:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485873920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463623.639472:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788463623.639542:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485873920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.639624:0:17054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485874048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463623.639662:0:17054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463623.640000:0:17054:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463623.640084:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485874048 00000100:00100000:2.0:1788463623.640090:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485874048 00000100:00100000:2.0:1788463623.640114:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788463623.640120:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485874048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463623.640203:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:61537c78-f571-4169-84d6-9d8a2058e62c+24:17054:x1875339485874048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463623.640210:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788463623.640278:0:17054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:61537c78-f571-4169-84d6-9d8a2058e62c:17054:1875339485874048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788463623.641207:0:20155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788463623.641978:0:17054:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788463623.642001:0:17054:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463623.642011:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463623.642388:0:17054:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.153@tcp lock: ffff961787d0ce00/0x841acb7f42a3ae09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x841acb7f42a3ae10 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463623.813156:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463624.070482:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485874176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788463624.070561:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463624.070649:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485874176 00000100:00100000:0.0:1788463624.070657:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485874176 00000100:00100000:0.0:1788463624.070706:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463624.070714:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485874176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788463624.070750:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788463624.070797:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485874176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463624.070804:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463624.070856:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485874176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788463624.078048:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463624.078073:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485874304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463624.078143:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463624.080001:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485874304 00000100:00100000:3.0:1788463624.080020:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485874304 00000100:00100000:3.0:1788463624.085054:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463624.085074:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485874304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788463624.085116:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788463624.085216:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485874304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (7073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463624.085225:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463624.085390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188553c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485874304:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788463624.133186:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463624.836874:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463625.861850:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463626.000263:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.001650:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899456 00000100:00100000:1.0:1788463626.001662:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899456 00000100:00100000:1.0:1788463626.001744:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:1.0:1788463626.001755:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+6:15587:x1875339466899456:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463626.001775:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.001795:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476ba5 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001857:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001872:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001883:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001911:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001928:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.001935:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002009:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002016:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002023:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463626.002057:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463626.002061:0:17056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463626.002097:0:17056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002107:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002113:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002121:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002136:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.002141:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002149:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002160:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:1.0:1788463626.002164:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.002169:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002175:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002188:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002194:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002199:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002204:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.002207:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002213:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002229:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff961884f9db00) 00010000:00010000:1.0:1788463626.002231:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.002234:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002240:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002269:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ba5 expref: 8 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002281:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d600/0x841acb7f42a3ae2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476ba5 expref: 7 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.002288:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463626.002290:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463626.002293:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0d600, rc 0) 00000100:00100000:1.0:1788463626.002347:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+7:15587:x1875339466899456:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 595us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.002354:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00080000:0.0:1788463626.002570:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463626.013719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.013876:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899584 00000100:00100000:0.0:1788463626.013886:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899584 00000100:00100000:0.0:1788463626.013948:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:0.0:1788463626.013974:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11b4f176-a68a-42e0-807e-b5954986c863+7:15587:x1875339466899584:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788463626.014082:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11b4f176-a68a-42e0-807e-b5954986c863+7:15587:x1875339466899584:12345-192.168.204.53@tcp:900:lhsmtool_posix.0 Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463626.014090:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:2.0:1788463626.034981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.035651:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899840 00000100:00100000:1.0:1788463626.035669:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899840 00000100:00100000:1.0:1788463626.035806:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463626.035821:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+7:15587:x1875339466899840:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463626.035858:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.035889:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bac expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.036183:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.036201:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.036226:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038648:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038678:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038692:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038828:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c200/0x841acb7f42a3ae48 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038837:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c200/0x841acb7f42a3ae48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.038859:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c200/0x841acb7f42a3ae48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463626.038872:0:17057:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788463626.042712:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.042747:0:17057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.042755:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.042762:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.042768:0:17057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.042776:0:17057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.042794:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff961884f9da00) 00010000:00010000:1.0:1788463626.042797:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.042802:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043380:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043400:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043407:0:17057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043412:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043418:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.043432:0:17057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043439:0:17057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043449:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff961884f9db00) 00010000:00010000:1.0:1788463626.043452:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.043456:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.043462:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae41 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.049558:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bac expref: 10 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.049634:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c200/0x841acb7f42a3ae48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bac expref: 9 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.049647:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d300) 00010000:00010000:1.0:1788463626.049651:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.049656:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0c200, rc 0) 00000100:00100000:1.0:1788463626.051408:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+9:15587:x1875339466899840:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 15574us (16422us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788463626.051425:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:3.0:1788463626.063437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.063645:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466899968 00000100:00100000:1.0:1788463626.063657:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466899968 00000100:00100000:1.0:1788463626.063727:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463626.063739:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+9:15587:x1875339466899968:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788463626.063899:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+9:15587:x1875339466899968:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 162us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.063907:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:2.0:1788463626.068694:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.069136:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900096 00000100:00100000:1.0:1788463626.069151:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900096 00000100:00100000:1.0:1788463626.069331:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:1.0:1788463626.069346:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:15587:x1875339466900096:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788463626.073097:0:17058:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3686us 00000100:00080000:0.0:1788463626.079353:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788463626.121197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.121484:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900224 00000100:00100000:1.0:1788463626.121498:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900224 00000100:00100000:1.0:1788463626.121616:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:1.0:1788463626.121628:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+9:15593:x1875339466900224:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463626.121654:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.121690:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bb3 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121786:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121806:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121821:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121850:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121880:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121887:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121939:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121947:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121954:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121971:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0c800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.121976:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121984:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.121998:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:1.0:1788463626.122002:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.122017:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122024:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0c800/0x841acb7f42a3ae5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122042:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122055:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122061:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122066:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961787d0cc00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463626.122070:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122076:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122085:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:1.0:1788463626.122088:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.122091:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122097:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0cc00/0x841acb7f42a3ae64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122145:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bb3 expref: 10 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122157:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:1.0:1788463626.122159:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463626.122163:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0da00/0x841acb7f42a3ae56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bb3 expref: 10 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.122184:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961787d0da00, rc 0) 00000100:00100000:1.0:1788463626.122268:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+9:15593:x1875339466900224:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 643us (1088us total) trans 0 rc 301/301 00000100:00100000:1.0:1788463626.122276:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:3.0:1788463626.132791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.133169:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900352 00000100:00100000:1.0:1788463626.133184:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900352 00000100:00100000:1.0:1788463626.133252:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463626.133264:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11b4f176-a68a-42e0-807e-b5954986c863+9:15593:x1875339466900352:12345-192.168.204.53@tcp:700:lfs.0 00000100:00100000:1.0:1788463626.133379:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:11b4f176-a68a-42e0-807e-b5954986c863+9:15593:x1875339466900352:12345-192.168.204.53@tcp:700:lfs.0 Request processed in 117us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.133388:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:2.0:1788463626.148392:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:15587:x1875339466900096:12345-192.168.204.53@tcp:59:lhsmtool_posix.0 Request processed in 79028us (79692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463626.148413:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463626.154918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463626.160298:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900608 00000100:00100000:2.0:1788463626.160319:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900608 00000100:00100000:0.0:1788463626.161170:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:0.0:1788463626.161188:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+9:15593:x1875339466900608:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:0.0:1788463626.161345:0:17057:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463626.161825:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3ad84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b20 expref: 9 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.161859:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:0.0:1788463626.161866:0:17057:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463626.162223:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.162243:0:17057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 5 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.162254:0:17057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.162303:0:17057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 5 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.162321:0:17057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 5 pid: 18932 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463626.162341:0:17057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17057:1875339485874432:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463626.162487:0:17057:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463626.169457:0:17057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188cf32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17057:1875339485874432:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463626.169502:0:17057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463626.170653:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.171130:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900736 00000100:00100000:3.0:1788463626.171144:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900736 00010000:00010000:3.0:1788463626.171230:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 6 pid: 18932 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463626.171237:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463626.171284:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:3.0:1788463626.171296:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2401:x1875339466900736:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463626.171314:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463626.171323:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 6 pid: 18932 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171339:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 6 pid: 18932 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171398:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961787d0d000/0x841acb7f42a3adc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476b90 expref: 6 pid: 18932 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171423:0:17041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:3.0:1788463626.171430:0:17041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171441:0:17041:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171450:0:17041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.171493:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463626.171600:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2401:x1875339466900736:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 305us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463626.171612:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00010000:00010000:1.0:1788463626.172420:0:17057:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.172686:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.172727:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.172742:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.172769:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175458:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175490:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175506:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463626.175541:0:17057:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1327662 reply state 000000001a828667 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175745:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175758:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463626.175762:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463626.175770:0:17057:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788463626.175779:0:17057:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788463626.175792:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175799:0:17057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175807:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175815:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463626.175821:0:17057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175830:0:17057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175918:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961894655e00) 00010000:00010000:0.0:1788463626.175920:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463626.175925:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.175944:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae6b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463626.176074:0:17057:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1327662 reply state 000000001a828667 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.176087:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.176093:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:0.0:1788463626.176096:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463626.176099:0:17057:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788463626.176307:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+10:15593:x1875339466900608:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 15118us (21399us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788463626.176318:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000040:00080000:1.0:1788463626.180321:0:17809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788463626.245809:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463626.255762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.255892:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900864 00000100:00100000:3.0:1788463626.255906:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900864 00000100:00100000:3.0:1788463626.255986:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:3.0:1788463626.255998:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+10:15601:x1875339466900864:12345-192.168.204.53@tcp:101:lctl.0 00010000:00010000:3.0:1788463626.256037:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463626.256068:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3ae80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bba expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256158:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256194:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256210:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463626.256270:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788463626.256274:0:17056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463626.256318:0:17056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256365:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3ae80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bba expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256398:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812400/0x841acb7f42a3ae87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bba expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.256408:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463626.256412:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463626.256416:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812400, rc 0) 00000100:00100000:3.0:1788463626.256961:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+11:15601:x1875339466900864:12345-192.168.204.53@tcp:101:lctl.0 Request processed in 962us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463626.256971:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:3.0:1788463626.288992:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.289342:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466900992 00000100:00100000:1.0:1788463626.289355:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466900992 00000100:00100000:1.0:1788463626.289436:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463626.289448:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:15602:x1875339466900992:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463626.289476:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.289503:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3ae8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bc1 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289664:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289683:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289698:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463626.289760:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788463626.289765:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788463626.289791:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289823:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3ae8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc1 expref: 7 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289871:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde000/0x841acb7f42a3ae95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc1 expref: 6 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.289882:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:1.0:1788463626.289886:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463626.289890:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bde000, rc 0) 00000100:00100000:1.0:1788463626.289986:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15602:x1875339466900992:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 540us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.289994:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:1.0:1788463626.296171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.296611:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466901120 00000100:00100000:0.0:1788463626.296627:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466901120 00000100:00100000:0.0:1788463626.296713:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:0.0:1788463626.296726:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:15602:x1875339466901120:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463626.296753:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463626.296782:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bc8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296874:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296894:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296930:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296944:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296952:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.296958:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297058:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297067:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297074:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463626.297124:0:17058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463626.297129:0:17058:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463626.297153:0:17058:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297167:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297175:0:17058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297192:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297199:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463626.297204:0:17058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297213:0:17058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297228:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463626.297231:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463626.297237:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297244:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297261:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297266:0:17058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297271:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297276:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463626.297279:0:17058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297295:0:17058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297304:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:0.0:1788463626.297306:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463626.297309:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297315:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3aeaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297346:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3ae9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc8 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297362:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc8 expref: 7 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.297370:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463626.297373:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463626.297376:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4200, rc 0) 00000100:00100000:0.0:1788463626.297462:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+7:15602:x1875339466901120:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 738us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463626.297471:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:3.0:1788463626.304909:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.305467:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466901248 00000100:00100000:0.0:1788463626.305486:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466901248 00000100:00080000:3.0:1788463626.305612:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788463626.305636:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463626.305649:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:15602:x1875339466901248:12345-192.168.204.53@tcp:900:lfs.0 00000100:00100000:0.0:1788463626.305782:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:15602:x1875339466901248:12345-192.168.204.53@tcp:900:lfs.0 Request processed in 136us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463626.305791:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:2.0:1788463626.314248:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.314374:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466901504 00000100:00100000:1.0:1788463626.314388:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466901504 00000100:00100000:1.0:1788463626.314470:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:1.0:1788463626.314483:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+7:15602:x1875339466901504:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463626.314512:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.314551:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aeb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bcf expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463626.314755:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788463626.314894:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aeb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bcf expref: 9 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.314912:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:1.0:1788463626.314916:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463626.314922:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aeb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bcf expref: 9 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.314964:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:1.0:1788463626.315213:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+8:15602:x1875339466901504:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 732us (980us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788463626.315223:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:3.0:1788463626.320202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.321555:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466901760 00000100:00100000:1.0:1788463626.321606:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466901760 00000100:00100000:1.0:1788463626.321706:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:1.0:1788463626.321719:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+8:15602:x1875339466901760:12345-192.168.204.53@tcp:36:lfs.0 00010000:00010000:1.0:1788463626.321798:0:17056:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463626.321837:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3aeb1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bc8 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.321864:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:1.0:1788463626.321871:0:17056:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463626.321903:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.321919:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.321931:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463626.322209:0:17056:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000279bfcf4 reply state 000000006d4ca9c4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.322224:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.322251:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:1.0:1788463626.322253:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788463626.322257:0:17056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788463626.322266:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788463626.322393:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+9:15602:x1875339466901760:12345-192.168.204.53@tcp:36:lfs.0 Request processed in 676us (2200us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788463626.322402:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463626.334888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.335149:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902016 00000100:00100000:0.0:1788463626.335159:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902016 00000100:00100000:0.0:1788463626.335214:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463626.335224:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+9:15602:x1875339466902016:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463626.335714:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+10:15602:x1875339466902016:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 490us (833us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788463626.335722:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463626.343287:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.343656:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902272 00000100:00100000:1.0:1788463626.343668:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902272 00000100:00100000:1.0:1788463626.343740:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:1.0:1788463626.343758:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+10:15602:x1875339466902272:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:1.0:1788463626.343788:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463626.343813:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3aecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bd6 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344004:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344022:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344033:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344043:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344050:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463626.344068:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463626.345350:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788463626.345990:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346004:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346014:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346020:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463626.346025:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346032:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346047:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463626.346050:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463626.346056:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346062:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3aed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346090:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346100:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346499:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346506:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463626.346508:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346515:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346524:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:2.0:1788463626.346526:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463626.346529:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346534:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3aedb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346953:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3aecd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bd6 expref: 12 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346966:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463626.346968:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463626.346983:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdec00/0x841acb7f42a3aecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bd6 expref: 12 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.346995:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdec00, rc 0) 00000100:00100000:2.0:1788463626.347071:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+11:15602:x1875339466902272:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 3321us (3794us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788463626.347079:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:1.0:1788463626.356619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.356781:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902400 00000100:00100000:3.0:1788463626.356791:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902400 00000100:00100000:3.0:1788463626.356904:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:3.0:1788463626.356925:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+11:15602:x1875339466902400:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463626.356948:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463626.356969:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3aee9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bdd expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357067:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357082:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357093:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463626.357115:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788463626.357119:0:17056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463626.357140:0:17056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357167:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882813c00/0x841acb7f42a3aee9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 13 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357184:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.357193:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:3.0:1788463626.357196:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463626.357213:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961882812000, rc 0) 00000100:00100000:3.0:1788463626.357287:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:15602:x1875339466902400:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 373us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463626.357294:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 35 00000100:00100000:3.0:1788463626.373841:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.373880:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902528 00000100:00100000:3.0:1788463626.373889:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902528 00000100:00100000:3.0:1788463626.373948:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:3.0:1788463626.373958:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:15602:x1875339466902528:12345-192.168.204.53@tcp:37:lfs.0 00000100:00100000:1.0:1788463626.382759:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:15602:x1875339466902528:12345-192.168.204.53@tcp:37:lfs.0 Request processed in 8787us (8926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.382778:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463626.402775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.402923:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902784 00000100:00100000:3.0:1788463626.402934:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902784 00000100:00100000:3.0:1788463626.402992:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463626.403001:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961882aca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:15602:x1875339466902784:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463626.403264:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961882aca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+13:15602:x1875339466902784:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 263us (511us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788463626.403272:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 4 00000100:00100000:3.0:1788463626.524647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.524833:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466902912 00000100:00100000:0.0:1788463626.524845:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466902912 00000100:00100000:0.0:1788463626.524970:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:0.0:1788463626.524981:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+11:15608:x1875339466902912:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463626.525002:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463626.525025:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476be4 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525089:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525104:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525116:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525139:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525160:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525168:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525245:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525255:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.525261:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463626.525310:0:17057:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788463626.525314:0:17057:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463626.526623:0:17057:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526645:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526652:0:17057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526658:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526664:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463626.526668:0:17057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526686:0:17057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526701:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463626.526705:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463626.526710:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526716:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3aefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526730:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526737:0:17057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526743:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526749:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463626.526752:0:17057:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526758:0:17057:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526766:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:0.0:1788463626.526768:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463626.526771:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526786:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4400/0x841acb7f42a3af05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526824:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3aef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476be4 expref: 13 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526837:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5400/0x841acb7f42a3af0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476be4 expref: 12 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.526845:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463626.526846:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788463626.526849:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5400, rc 0) 00000100:00100000:0.0:1788463626.526976:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+12:15608:x1875339466902912:12345-192.168.204.53@tcp:101:bash.0 Request processed in 1996us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463626.526985:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 36 00000100:00100000:0.0:1788463626.535670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.535804:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466903040 00000100:00100000:1.0:1788463626.535815:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466903040 00000100:00100000:1.0:1788463626.535875:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:1.0:1788463626.535887:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11b4f176-a68a-42e0-807e-b5954986c863+5:15608:x1875339466903040:12345-192.168.204.53@tcp:900:bash.0 00000100:00100000:1.0:1788463626.535975:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:11b4f176-a68a-42e0-807e-b5954986c863+5:15608:x1875339466903040:12345-192.168.204.53@tcp:900:bash.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463626.535983:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:1.0:1788463626.549650:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463626.549744:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466903296 00000100:00100000:2.0:1788463626.549754:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466903296 00000100:00100000:2.0:1788463626.550155:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:2.0:1788463626.550166:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+12:15608:x1875339466903296:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463626.550197:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463626.550523:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3af13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476beb expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.550691:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.550706:0:17058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.550715:0:17058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.550749:0:17058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.550764:0:17058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 12 pid: 17056 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463626.550799:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874560:192.168.204.53@tcp:104: 00000100:00100000:2.0:1788463626.550998:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188689ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463626.563865:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874560:192.168.204.53@tcp:104: 00010000:00010000:2.0:1788463626.563903:0:17058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463626.571188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.571308:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466903424 00000100:00100000:3.0:1788463626.571318:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466903424 00010000:00010000:3.0:1788463626.571358:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 13 pid: 17056 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463626.571397:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 16 00000100:00100000:3.0:1788463626.571405:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+13:2403:x1875339466903424:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463626.571419:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463626.571426:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 13 pid: 17056 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571453:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 13 pid: 17056 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571481:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961882812000/0x841acb7f42a3aef0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bdd expref: 13 pid: 17056 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571499:0:17042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:3.0:1788463626.571506:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571515:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571524:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.571564:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463626.571675:0:17058:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.571684:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.571708:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.571717:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.571726:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463626.571861:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:2403:x1875339466903424:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 455us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463626.571869:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 16 00010000:00010000:2.0:1788463626.572198:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572208:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572473:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463626.572501:0:17058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463626.572533:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572552:0:17058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572559:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572566:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e26c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463626.572571:0:17058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572604:0:17058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572615:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:2.0:1788463626.572618:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463626.572623:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572629:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463626.572641:0:17058:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dca12c85 reply state 00000000642a17d9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572653:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572670:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961894655200) 00010000:00010000:2.0:1788463626.572672:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463626.572675:0:17058:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463626.572714:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3af13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 15 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572729:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 14 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.572736:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463626.572738:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788463626.572741:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e27e00, rc 0) 00000100:00100000:2.0:1788463626.572789:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+15:15608:x1875339466903296:12345-192.168.204.53@tcp:101:bash.0 Request processed in 22625us (23149us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788463626.572796:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 37 00000100:00100000:1.0:1788463626.591316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463626.591433:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466903552 00000100:00100000:2.0:1788463626.591443:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466903552 00000100:00100000:2.0:1788463626.591511:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:2.0:1788463626.591522:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+15:15608:x1875339466903552:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463626.591560:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463626.591619:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3af36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bf2 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591688:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591701:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591726:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463626.591774:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788463626.591778:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463626.591798:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591808:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591845:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26800/0x841acb7f42a3af36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bf2 expref: 17 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591865:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bf2 expref: 16 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.591873:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463626.591876:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463626.591880:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618c1e26c00, rc 0) 00000100:00100000:2.0:1788463626.591941:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+16:15608:x1875339466903552:12345-192.168.204.53@tcp:101:bash.0 Request processed in 420us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463626.591948:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 38 00000100:00100000:3.0:1788463626.597189:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.597293:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466903808 00000100:00100000:0.0:1788463626.597303:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466903808 00000100:00100000:0.0:1788463626.597357:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:0.0:1788463626.597366:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+16:15608:x1875339466903808:12345-192.168.204.53@tcp:35:bash.0 00000100:00100000:0.0:1788463626.597681:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+17:15608:x1875339466903808:12345-192.168.204.53@tcp:35:bash.0 Request processed in 314us (498us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788463626.597689:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 5 00000100:00100000:1.0:1788463626.733303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.733560:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466904064 00000100:00100000:3.0:1788463626.733570:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466904064 00000100:00100000:3.0:1788463626.733969:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:3.0:1788463626.733982:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+17:15618:x1875339466904064:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:3.0:1788463626.734020:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463626.734042:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ec00/0x841acb7f42a3af44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476bf9 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463626.734164:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788463626.734273:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ec00/0x841acb7f42a3af44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bf9 expref: 19 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.734288:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:3.0:1788463626.734291:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463626.734297:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ec00/0x841acb7f42a3af44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bf9 expref: 19 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463626.734313:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00ec00, rc 0) 00000100:00100000:3.0:1788463626.734401:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+18:15618:x1875339466904064:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 422us (1108us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788463626.734409:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 39 00000100:00100000:2.0:1788463626.739492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463626.739661:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466904320 00000100:00100000:0.0:1788463626.739673:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466904320 00000100:00100000:0.0:1788463626.739791:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:0.0:1788463626.739817:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+18:15618:x1875339466904320:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463626.740294:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+19:15618:x1875339466904320:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 480us (811us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788463626.740302:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 6 00000100:00100000:1.0:1788463626.811252:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463626.812622:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466904576 00000100:00100000:2.0:1788463626.812635:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466904576 00000100:00100000:2.0:1788463626.812714:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:2.0:1788463626.812738:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+19:15621:x1875339466904576:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463626.812779:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463626.812802:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c00 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.812910:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20c00/0x841acb7f42a3af59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.812933:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20c00/0x841acb7f42a3af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.812944:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20c00/0x841acb7f42a3af59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463626.812954:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463626.813651:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c00 expref: 22 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.813672:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20c00/0x841acb7f42a3af59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c00 expref: 21 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.813681:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463626.813684:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463626.813687:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20c00, rc 0) 00000100:00100000:2.0:1788463626.814061:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+21:15621:x1875339466904576:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 1258us (2754us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788463626.814070:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 40 00000100:00100000:3.0:1788463626.830511:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463626.832688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463626.832966:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466904832 00000100:00100000:2.0:1788463626.832976:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466904832 00000100:00100000:2.0:1788463626.833039:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:2.0:1788463626.833060:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+21:15621:x1875339466904832:12345-192.168.204.53@tcp:54:lfs.0 00010000:00010000:2.0:1788463626.833123:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833140:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833151:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833187:0:17058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833194:0:17058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833201:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833207:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463626.833212:0:17058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833219:0:17058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833230:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463626.833233:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463626.833237:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463626.833243:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463626.833319:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+21:15621:x1875339466904832:12345-192.168.204.53@tcp:54:lfs.0 Request processed in 261us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463626.833327:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 41 00000100:00100000:0.0:1788463626.842191:0:20084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466904704 00000100:00100000:0.0:1788463626.842216:0:20084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466904704 00000100:00100000:0.0:1788463626.842299:0:20084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:0.0:1788463626.842310:0:20084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+21:2403:x1875339466904704:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463626.842325:0:20084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463626.842354:0:20084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20c00/0x841acb7f42a3af59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c00 expref: 21 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463626.842376:0:20084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463626.842383:0:20084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463626.842458:0:20084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+20:2403:x1875339466904704:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 149us (11957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463626.842466:0:20084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:1.0:1788463626.845301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463626.845393:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466905088 00000100:00100000:3.0:1788463626.845403:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466905088 00000100:00100000:3.0:1788463626.845927:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 7 00000100:00100000:3.0:1788463626.845940:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+20:15621:x1875339466905088:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:3.0:1788463626.846181:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+21:15621:x1875339466905088:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 244us (888us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788463626.846189:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 7 00010000:00010000:1.0:1788463626.883983:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463627.328552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463627.328953:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466905344 00000100:00100000:2.0:1788463627.328966:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466905344 00000100:00100000:2.0:1788463627.329054:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:2.0:1788463627.329065:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+21:15652:x1875339466905344:12345-192.168.204.53@tcp:101:cat.0 00010000:00010000:2.0:1788463627.329101:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463627.329124:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c07 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.329234:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.329250:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.329262:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463627.329272:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463627.329393:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c07 expref: 24 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.329415:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c07 expref: 23 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.329423:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463627.329440:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463627.329445:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21400, rc 0) 00000100:00100000:2.0:1788463627.330425:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+23:15652:x1875339466905344:12345-192.168.204.53@tcp:101:cat.0 Request processed in 1354us (1877us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788463627.330437:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 42 00000100:00100000:1.0:1788463627.337310:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463627.337358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463627.337463:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466905728 00000100:00100000:2.0:1788463627.337474:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466905728 00000100:00100000:3.0:1788463627.337548:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466905600 00000100:00100000:3.0:1788463627.337553:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466905600 00000100:00100000:2.0:1788463627.337566:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:2.0:1788463627.337594:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b4f176-a68a-42e0-807e-b5954986c863+24:2401:x1875339466905728:12345-192.168.204.53@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788463627.337606:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:3.0:1788463627.337613:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+24:15652:x1875339466905600:12345-192.168.204.53@tcp:35:cat.0 00010000:00010000:2.0:1788463627.337623:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463627.337649:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c07 expref: 24 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.337676:0:17043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463627.337682:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463627.337728:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b4f176-a68a-42e0-807e-b5954986c863+23:2401:x1875339466905728:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 154us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463627.337735:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 1 00000100:00100000:3.0:1788463627.337889:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+23:15652:x1875339466905600:12345-192.168.204.53@tcp:35:cat.0 Request processed in 275us (587us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788463627.337896:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 8 00000100:00100000:1.0:1788463627.471328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463627.471420:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466905984 00000100:00100000:2.0:1788463627.471432:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466905984 00000100:00100000:2.0:1788463627.471509:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:2.0:1788463627.471532:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+23:15658:x1875339466905984:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:2.0:1788463627.471807:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463627.471831:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c0e expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.471944:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.471966:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.471978:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463627.471991:0:17058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463627.472132:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21400/0x841acb7f42a3af83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c0e expref: 26 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.472152:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c0e expref: 25 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.472162:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463627.472165:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463627.472169:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e20a00, rc 0) 00000100:00100000:2.0:1788463627.472235:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+25:15658:x1875339466905984:12345-192.168.204.53@tcp:101:dd.0 Request processed in 716us (916us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788463627.472243:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 43 00000100:00100000:0.0:1788463627.484283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463627.484345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463627.484563:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466906240 00000100:00100000:1.0:1788463627.484611:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466906240 00000100:00100000:1.0:1788463627.484687:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:1.0:1788463627.484698:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+25:15658:x1875339466906240:12345-192.168.204.53@tcp:101:dd.0 00010000:00010000:1.0:1788463627.484725:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463627.484748:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3af98 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c15 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484787:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484802:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484826:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484961:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3af98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 27 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484983:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 26 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463627.484993:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:1.0:1788463627.484996:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463627.484999:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961786bdf600, rc 0) 00000100:00100000:1.0:1788463627.485062:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+26:15658:x1875339466906240:12345-192.168.204.53@tcp:101:dd.0 Request processed in 366us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463627.485069:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 44 00000100:00100000:3.0:1788463627.485896:0:20084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466906112 00000100:00100000:3.0:1788463627.485904:0:20084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466906112 00000100:00100000:3.0:1788463627.485947:0:20084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:3.0:1788463627.485956:0:20084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+26:2403:x1875339466906112:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463627.485967:0:20084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463627.485984:0:20084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3af8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c0e expref: 26 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.485998:0:20084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463627.486002:0:20084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463627.486053:0:20084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+25:2403:x1875339466906112:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 98us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463627.486060:0:20084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 2 00000100:00100000:0.0:1788463627.498328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463627.498418:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466906496 00000100:00100000:3.0:1788463627.498428:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466906496 00000100:00100000:3.0:1788463627.498493:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 45 00000100:00100000:3.0:1788463627.498504:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+25:15658:x1875339466906496:12345-192.168.204.53@tcp:36:dd.0 00010000:00010000:3.0:1788463627.498572:0:17056:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463627.498639:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e26c00/0x841acb7f42a3af3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476bf2 expref: 25 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.498661:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463627.498667:0:17056:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463627.498865:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.498881:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.498892:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463627.498935:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788463627.498959:0:17056:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee0f1ba1 reply state 0000000068f91c18 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.498971:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463627.499242:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463627.499246:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788463627.499249:0:17056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463627.499343:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+27:15658:x1875339466906496:12345-192.168.204.53@tcp:36:dd.0 Request processed in 840us (1025us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788463627.499351:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 45 00000020:00080000:3.0:1788463627.499356:0:17056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788463627.662894:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463627.663397:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466906752 00000100:00100000:3.0:1788463627.663409:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466906752 00000100:00100000:3.0:1788463627.663714:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 9 00000100:00100000:3.0:1788463627.663727:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+27:15658:x1875339466906752:12345-192.168.204.53@tcp:35:dd.0 00000100:00100000:3.0:1788463627.664023:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+28:15658:x1875339466906752:12345-192.168.204.53@tcp:35:dd.0 Request processed in 298us (1215us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788463627.664031:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 9 00010000:00010000:3.0:1788463627.909031:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463627.931268:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463627.931455:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466906880 00000100:00100000:2.0:1788463627.931466:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466906880 00000100:00100000:2.0:1788463627.931549:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:2.0:1788463627.931561:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+28:15672:x1875339466906880:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:2.0:1788463627.931768:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463627.931790:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c1c expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931893:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931910:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931922:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931932:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931940:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.931947:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932161:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932172:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932179:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463627.932300:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788463627.932304:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788463627.932346:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932369:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932377:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932382:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932389:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932394:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463627.932398:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932405:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932736:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:2.0:1788463627.932739:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463627.932744:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932750:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20e00/0x841acb7f42a3afb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932766:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932772:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932787:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932793:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463627.932795:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932801:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932939:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961894655200) 00010000:00010000:2.0:1788463627.932943:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463627.932948:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.932954:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3afbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.933058:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c1c expref: 30 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.933073:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c1c expref: 29 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463627.933082:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463627.933084:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463627.933087:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21800, rc 0) 00000100:00100000:2.0:1788463627.933212:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+29:15672:x1875339466906880:12345-192.168.204.53@tcp:101:stat.0 Request processed in 1653us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463627.933231:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 46 00000100:00100000:1.0:1788463628.025734:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025921:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.025983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.026006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.026034:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907264 00000100:00100000:1.0:1788463628.026044:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907264 00000100:00100000:1.0:1788463628.026100:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907776 00000100:00100000:1.0:1788463628.026103:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907776 00000100:00100000:1.0:1788463628.026118:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907392 00000100:00100000:1.0:1788463628.026121:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907392 00000100:00100000:1.0:1788463628.026131:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907904 00000100:00100000:1.0:1788463628.026152:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907904 00000100:00100000:1.0:1788463628.026172:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463628.026182:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907264:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026250:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907264:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 69us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026262:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463628.026280:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463628.026287:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907776:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026311:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907776:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026317:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 25 00000100:00100000:1.0:1788463628.026329:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:1.0:1788463628.026351:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907392:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463628.026356:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463628.026370:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907904:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026383:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907392:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026389:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463628.026410:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907904:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026419:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907520 00000100:00100000:1.0:1788463628.026425:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907520 00000100:00100000:0.0:1788463628.026427:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:1.0:1788463628.026464:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907136 00000100:00100000:1.0:1788463628.026467:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907136 00000100:00100000:1.0:1788463628.026483:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907648 00000100:00100000:1.0:1788463628.026486:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907648 00000100:00100000:1.0:1788463628.026518:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463628.026526:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:2403:x1875339466907520:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026562:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+12:2403:x1875339466907520:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026568:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463628.026630:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:1.0:1788463628.026636:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907136:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026662:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+5:2403:x1875339466907136:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026668:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:1.0:1788463628.026681:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:1.0:1788463628.026686:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907648:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:1.0:1788463628.026708:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2403:x1875339466907648:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.026713:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00080000:3.0:1788463628.026813:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788463628.026818:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463628.026821:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463628.026823:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463628.026954:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466907008 00000100:00100000:2.0:1788463628.026959:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466907008 00000100:00100000:2.0:1788463628.026994:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00100000:2.0:1788463628.027001:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466907008:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463628.027045:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2403:x1875339466907008:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 44us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463628.027052:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 167 00000100:00100000:1.0:1788463628.032095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463628.032280:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466908160 00000100:00100000:2.0:1788463628.032292:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466908160 00000100:00100000:2.0:1788463628.032380:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 47 00000100:00100000:2.0:1788463628.032392:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+29:15678:x1875339466908160:12345-192.168.204.53@tcp:36:truncate.0 00010000:00010000:2.0:1788463628.032449:0:17057:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463628.032481:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c1c expref: 29 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.032503:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463628.032521:0:17057:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463628.032904:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.032921:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.032948:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463628.033010:0:17057:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788463628.033036:0:17057:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de568916 reply state 00000000ff5770e6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.033050:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.033058:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463628.033061:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788463628.033064:0:17057:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463628.033182:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+31:15678:x1875339466908160:12345-192.168.204.53@tcp:36:truncate.0 Request processed in 792us (1099us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788463628.033191:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 47 00000020:00080000:2.0:1788463628.033197:0:17057:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1788463628.034047:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463628.217268:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463628.220656:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466908288 00000100:00100000:0.0:1788463628.220675:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466908288 00000100:00100000:0.0:1788463628.220761:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463628.220772:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+31:15692:x1875339466908288:12345-192.168.204.53@tcp:101:stat.0 00010000:00010000:0.0:1788463628.220799:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463628.220824:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3afd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c23 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220893:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220909:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220921:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220932:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220939:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.220945:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221014:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221041:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221047:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463628.221092:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788463628.221097:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463628.221119:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221131:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221140:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221148:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221155:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221160:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463628.221165:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221174:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221187:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463628.221196:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463628.221201:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221208:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5200/0x841acb7f42a3afd7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221223:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221230:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221237:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221241:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463628.221244:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221250:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221257:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961894655200) 00010000:00010000:0.0:1788463628.221260:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463628.221263:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221269:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3afde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221295:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3afd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 33 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221322:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 32 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.221329:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463628.221331:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463628.221333:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5c00, rc 0) 00000100:00100000:0.0:1788463628.221652:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+32:15692:x1875339466908288:12345-192.168.204.53@tcp:101:stat.0 Request processed in 880us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.221661:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 48 00000100:00100000:0.0:1788463628.359278:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463628.359624:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466908544 00000100:00100000:2.0:1788463628.359635:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466908544 00000100:00100000:2.0:1788463628.359706:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:2.0:1788463628.359716:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+32:15702:x1875339466908544:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:2.0:1788463628.359736:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463628.359755:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c2a expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463628.359850:0:17057:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788463628.359941:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c2a expref: 34 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.359955:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:2.0:1788463628.359959:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463628.359978:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21800/0x841acb7f42a3afec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c2a expref: 34 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.359992:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21800, rc 0) 00000100:00100000:2.0:1788463628.360572:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+33:15702:x1875339466908544:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 853us (1307us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788463628.360639:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 49 00000100:00100000:1.0:1788463628.368003:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463628.368090:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466908800 00000100:00100000:0.0:1788463628.368101:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466908800 00000100:00100000:0.0:1788463628.368287:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:0.0:1788463628.368300:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617878c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+33:15702:x1875339466908800:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463628.368630:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617878c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+34:15702:x1875339466908800:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 331us (636us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788463628.368638:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 10 00000100:00100000:1.0:1788463628.441911:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463628.447802:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909056 00000100:00100000:3.0:1788463628.447822:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909056 00000100:00100000:3.0:1788463628.447913:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:3.0:1788463628.447924:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+34:15708:x1875339466909056:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:3.0:1788463628.447949:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463628.447969:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ec00/0x841acb7f42a3affa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c31 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448363:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448380:0:17058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448388:0:17058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 35 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448397:0:17058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448430:0:17058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 35 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.448534:0:17058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 35 pid: 18932 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463628.448938:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874688:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463628.449292:0:17058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.449303:0:17058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463628.449313:0:17058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874816:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463628.449339:0:17058:0:(client.c:2716:ptlrpc_set_wait()) set ffff961883659240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463628.462311:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874688:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463628.462330:0:17058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17058:1875339485874816:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463628.462360:0:17058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463628.467513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.467647:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463628.468020:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909184 00000100:00100000:3.0:1788463628.468031:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909184 00010000:00010000:3.0:1788463628.468088:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 36 pid: 18932 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463628.468129:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909312 00000100:00100000:3.0:1788463628.468133:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909312 00010000:00010000:3.0:1788463628.468147:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 37 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463628.468174:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:3.0:1788463628.468184:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+37:2401:x1875339466909184:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463628.468199:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463628.468207:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 37 pid: 18932 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468238:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 37 pid: 18932 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468262:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3afe5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c23 expref: 37 pid: 18932 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468278:0:17042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463628.468283:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468292:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468299:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463628.468354:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+36:2401:x1875339466909184:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 171us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.468360:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 17 00000100:00100000:3.0:1788463628.468403:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 18 00000100:00100000:3.0:1788463628.468410:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+35:2401:x1875339466909312:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463628.468417:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463628.468422:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468431:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468456:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27e00/0x841acb7f42a3af28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476beb expref: 35 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468466:0:17042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463628.468470:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468487:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468495:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.468531:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463628.468551:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+34:2401:x1875339466909312:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 141us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.468558:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 18 00010000:00010000:0.0:1788463628.468854:0:17058:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.468875:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463628.468895:0:17058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788463628.469033:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ec00/0x841acb7f42a3affa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 35 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.469050:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 34 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.469057:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463628.469060:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788463628.469062:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00fe00, rc 0) 00000100:00100000:0.0:1788463628.469090:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+34:15708:x1875339466909056:12345-192.168.204.53@tcp:101:bash.0 Request processed in 21170us (27267us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788463628.469097:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 50 00000100:00100000:2.0:1788463628.477639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463628.477816:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909568 00000100:00100000:0.0:1788463628.477827:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909568 00000100:00100000:0.0:1788463628.477924:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 51 00000100:00100000:0.0:1788463628.477935:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+34:15708:x1875339466909568:12345-192.168.204.53@tcp:36:bash.0 00010000:00010000:0.0:1788463628.478184:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.478203:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.478214:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463628.478274:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1788463628.478305:0:17056:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029cb8d96 reply state 00000000e35ce511 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.478317:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.478325:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463628.478328:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463628.478332:0:17056:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463628.478430:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+37:15708:x1875339466909568:12345-192.168.204.53@tcp:36:bash.0 Request processed in 495us (799us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788463628.478437:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 51 00000020:00080000:0.0:1788463628.478442:0:17056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788463628.481254:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463628.482078:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909696 00000100:00100000:2.0:1788463628.482089:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909696 00000100:00100000:2.0:1788463628.482158:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:2.0:1788463628.482169:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+37:15708:x1875339466909696:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:2.0:1788463628.482199:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463628.482220:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3b016 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c38 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.482277:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3b016 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c38 expref: 38 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.482293:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3b016 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c38 expref: 38 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.482313:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463628.482317:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463628.482321:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961785e21000, rc 0) 00000100:00100000:2.0:1788463628.482386:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961787e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+38:15708:x1875339466909696:12345-192.168.204.53@tcp:101:bash.0 Request processed in 218us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463628.482393:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 52 00000100:00100000:1.0:1788463628.490947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463628.491084:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909824 00000100:00100000:0.0:1788463628.491096:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909824 00000100:00100000:0.0:1788463628.491159:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:0.0:1788463628.491170:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+38:15708:x1875339466909824:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463628.491190:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463628.491211:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b01d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c3f expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.491512:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.491529:0:17056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 39 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.491552:0:17056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.491727:0:17056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 39 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.491741:0:17056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 39 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463628.491755:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485874944:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463628.491879:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463628.497246:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.497318:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466909952 00000100:00100000:1.0:1788463628.497329:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466909952 00000100:00100000:3.0:1788463628.497377:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9617884f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485874944:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463628.497405:0:17056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497436:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 40 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463628.497531:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 19 00000100:00100000:1.0:1788463628.497541:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+40:2400:x1875339466909952:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463628.497557:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463628.497564:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 40 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497628:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 40 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497652:0:17042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00fe00/0x841acb7f42a3b001 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c31 expref: 40 pid: 17058 timeout: 767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497671:0:17042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:1.0:1788463628.497676:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497705:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497713:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.497745:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463628.497810:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+39:2400:x1875339466909952:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 270us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.497818:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 19 00010000:00010000:3.0:1788463628.498068:0:17056:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.498076:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463628.498132:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788463628.498143:0:17056:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788463628.498168:0:17056:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.498198:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b01d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c3f expref: 39 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.498213:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c3f expref: 38 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463628.498471:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463628.498475:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463628.498479:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4c00, rc 0) 00000100:00100000:3.0:1788463628.498537:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+38:15708:x1875339466909824:12345-192.168.204.53@tcp:101:bash.0 Request processed in 7368us (7788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.498544:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 53 00000100:00100000:0.0:1788463628.505162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463628.505518:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910208 00000100:00100000:1.0:1788463628.505528:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910208 00000100:00100000:1.0:1788463628.505616:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463628.505627:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b4f176-a68a-42e0-807e-b5954986c863+38:15708:x1875339466910208:12345-192.168.204.53@tcp:103:bash.0 00010000:00010000:1.0:1788463628.505643:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788463628.505668:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21000/0x841acb7f42a3b016 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c38 expref: 38 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.505689:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b024 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c3f expref: 37 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463628.505699:0:17041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:1.0:1788463628.505704:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463628.505763:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b4f176-a68a-42e0-807e-b5954986c863+36:15708:x1875339466910208:12345-192.168.204.53@tcp:103:bash.0 Request processed in 138us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463628.505769:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 3 00000100:00100000:1.0:1788463628.511869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463628.511956:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910336 00000100:00100000:2.0:1788463628.511978:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910336 00000100:00100000:2.0:1788463628.512039:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:2.0:1788463628.512050:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+36:15708:x1875339466910336:12345-192.168.204.53@tcp:58:bash.0 00010000:00010000:2.0:1788463628.512159:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.512177:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463628.512191:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463628.513754:0:17057:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463628.515299:0:17057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788463628.515544:0:17057:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788463628.515685:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+36:15708:x1875339466910336:12345-192.168.204.53@tcp:58:bash.0 Request processed in 3631us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463628.515696:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 54 00000100:00100000:3.0:1788463628.523970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463628.524335:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910464 00000100:00100000:0.0:1788463628.524347:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910464 00000100:00100000:0.0:1788463628.524413:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:0.0:1788463628.524425:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+36:15708:x1875339466910464:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463628.524447:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463628.524470:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c46 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524539:0:18932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524552:0:18932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 37 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524637:0:18932:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524652:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 37 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524666:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463628.524669:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463628.524673:0:18932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 37 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463628.524682:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4e00, rc 0) 00000100:00100000:0.0:1788463628.524736:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96189162bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+37:15708:x1875339466910464:12345-192.168.204.53@tcp:101:bash.0 Request processed in 312us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.524743:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 55 00000100:00100000:0.0:1788463628.675921:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485875072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463628.676001:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.676052:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485875584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.676079:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.676094:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485876096:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.676112:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.676129:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485876608:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.676152:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.676169:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788463628.676175:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485875200:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.676220:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.677719:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485875456:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.677802:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463628.678616:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485875328:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.678660:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.679174:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875200 00000100:00100000:3.0:1788463628.679184:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875200 00000100:00100000:3.0:1788463628.679236:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788463628.679244:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485875200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679302:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485875200:12345-0@lo:400:kworker.0 Request processed in 58us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.679311:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788463628.679349:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875584 00000100:00100000:3.0:1788463628.679352:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875584 00000100:00100000:3.0:1788463628.679416:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876096 00000100:00100000:3.0:1788463628.679420:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876096 00000100:00100000:3.0:1788463628.679433:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875456 00000100:00100000:3.0:1788463628.679435:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875456 00000100:00100000:3.0:1788463628.679448:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463628.679454:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485875584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679487:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485875584:12345-0@lo:400:kworker.0 Request processed in 33us (3407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.679494:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463628.679517:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463628.679524:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485876096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679553:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485876096:12345-0@lo:400:kworker.0 Request processed in 30us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.679559:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463628.679568:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463628.679600:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485875456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679656:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961891628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875339485875456:12345-0@lo:400:kworker.0 Request processed in 82us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.679662:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788463628.679681:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463628.679687:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463628.679697:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485875200:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679711:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3651:1875339485875456:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679721:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485875968:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679750:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.679771:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485876480:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.679794:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.679837:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485876992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788463628.679859:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463628.681135:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876608 00000100:00100000:2.0:1788463628.681146:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876608 00000100:00080000:2.0:1788463628.681178:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463628.681202:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875968 00000100:00100000:3.0:1788463628.681208:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875968 00000100:00100000:2.0:1788463628.681215:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876480 00000100:00100000:2.0:1788463628.681220:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876480 00000100:00100000:3.0:1788463628.681311:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463628.681321:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681330:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485875712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.681389:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188d111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485875968:12345-0@lo:400:kworker.0 Request processed in 68us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.681410:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485876224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.681464:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485876736:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.681476:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463628.681489:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463628.681536:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485875968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485875584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681561:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485876096:0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.681570:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875712 00000100:00100000:3.0:1788463628.681594:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875712 00000100:00100000:3.0:1788463628.681618:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876224 00000100:00100000:3.0:1788463628.681621:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876224 00000100:00100000:0.0:1788463628.681623:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875072 00000100:00100000:0.0:1788463628.681630:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875072 00000100:00100000:0.0:1788463628.681652:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876992 00000100:00100000:0.0:1788463628.681655:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876992 00000100:00100000:0.0:1788463628.681666:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463628.681672:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485875072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463628.681695:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788463628.681733:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485875072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (5733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.681740:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463628.681754:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463628.681760:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485876992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463628.681770:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788463628.681799:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485876992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.681813:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463628.681824:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876736 00000100:00100000:3.0:1788463628.681830:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876736 00000100:00100000:0.0:1788463628.681856:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961891628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485876992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463628.681886:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485875072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463628.681905:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463628.681914:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485876608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.681950:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875339485876608:12345-0@lo:400:kworker.0 Request processed in 38us (5797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.681958:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463628.681972:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463628.681978:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485875712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.682003:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188553df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875339485875712:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.682009:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463628.682019:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463628.682024:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485876224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.682047:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485876224:12345-0@lo:400:kworker.0 Request processed in 23us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.682052:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463628.682074:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875339485875712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.682084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485876224:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.682094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3648:1875339485876608:0@lo:400:kworker.0 00000100:00080000:2.0:1788463628.682389:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463628.682396:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463628.682399:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463628.682410:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485876736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463628.682424:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463628.682433:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485876480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.682453:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485876736:12345-0@lo:400:kworker.0 Request processed in 45us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.682460:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463628.682485:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188cf31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875339485876480:12345-0@lo:400:kworker.0 Request processed in 53us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463628.682517:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788463628.682540:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961786b47100 x1875339485876480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463628.682553:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3651:1875339485876480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.691481:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463628.691531:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485877120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463628.691613:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.691668:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485877120 00000100:00100000:0.0:1788463628.691675:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485877120 00000100:00100000:0.0:1788463628.691713:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463628.691721:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485877120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463628.691753:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788463628.694839:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875339485877120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3107us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.694854:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463628.694944:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3649:1875339485877120:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788463628.694995:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96188fba9c00 x1875339485876736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463628.695007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485876736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.695170:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485875840:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.695227:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463628.696359:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875328 00000100:00100000:0.0:1788463628.696370:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875328 00000100:00100000:0.0:1788463628.696426:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463628.696436:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485875328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463628.696523:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485875328:12345-0@lo:400:kworker.0 Request processed in 88us (17862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463628.696530:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463628.697443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485876352:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.697490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463628.697529:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485876864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463628.697555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463628.697625:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485875328:0@lo:400:kworker.0 00000100:00100000:2.0:1788463628.697838:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876864 00000100:00100000:2.0:1788463628.697845:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876864 00000100:00100000:2.0:1788463628.697884:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463628.697893:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485876864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463628.697914:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788463628.697957:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485876864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463628.697964:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463628.698147:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485875840 00000100:00100000:0.0:1788463628.698152:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485875840 00000100:00100000:3.0:1788463628.698175:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485876352 00000100:00100000:3.0:1788463628.698181:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485876352 00000100:00100000:0.0:1788463628.698193:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463628.698203:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485875840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788463628.698210:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463628.698248:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485875840:12345-0@lo:400:kworker.0 Request processed in 48us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.698263:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788463628.698266:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463628.698276:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485876352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463628.698320:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875339485876352:12345-0@lo:400:kworker.0 Request processed in 49us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463628.698327:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788463628.698723:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485875840:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.698735:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3650:1875339485876352:0@lo:400:kworker.0 00000100:00100000:1.0:1788463628.698751:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96189162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485876864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788463628.934082:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463629.187907:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485877248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788463629.187996:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463629.188075:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485877248 00000100:00100000:3.0:1788463629.188085:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485877248 00000100:00100000:3.0:1788463629.188138:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463629.188148:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485877248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788463629.188197:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788463629.188548:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463629.188560:0:3651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485877376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788463629.188615:0:3651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463629.188665:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485877376 00000100:00100000:1.0:1788463629.188669:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485877376 00000100:00100000:1.0:1788463629.188696:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463629.188702:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485877376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788463629.188721:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788463629.188772:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875339485877376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463629.188778:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788463629.189397:0:3651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3651:1875339485877376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788463629.199327:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875339485877248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11168us (11318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463629.199343:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788463629.199401:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3649:1875339485877248:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788463629.321066:0:17093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788463629.321075:0:17093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463629.321134:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788463629.321144:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788463629.321286:0:17093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17093:1875339485877504:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463629.321381:0:17093:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463629.335118:0:17093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96178700f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17093:1875339485877504:192.168.204.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463629.338186:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463629.338895:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910592 00000100:00100000:2.0:1788463629.338907:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910592 00000100:00100000:2.0:1788463629.339072:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:2.0:1788463629.339084:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+37:15710:x1875339466910592:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463629.339118:0:17057:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463629.340085:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+37:15710:x1875339466910592:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 996us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463629.340097:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 56 00000100:00100000:3.0:1788463629.348891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.349083:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910720 00000100:00100000:0.0:1788463629.349094:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910720 00000100:00100000:0.0:1788463629.349156:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:0.0:1788463629.349166:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+37:15710:x1875339466910720:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.349239:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349256:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349268:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349330:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349338:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349346:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349377:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349387:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349411:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463629.349461:0:18932:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788463629.349465:0:18932:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463629.349492:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349505:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349511:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349518:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349523:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.349527:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349534:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349545:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d300) 00010000:00010000:0.0:1788463629.349548:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.349553:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349559:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b039 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349631:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349638:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349644:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349649:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.349651:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349657:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349665:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff961890145c00) 00010000:00010000:0.0:1788463629.349668:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.349671:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349676:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b040 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349692:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349698:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349704:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349716:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.349719:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349726:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349734:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463629.349736:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.349740:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.349745:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b047 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.349815:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+37:15710:x1875339466910720:12345-192.168.204.53@tcp:34:lhsmtool_posix.0 Request processed in 650us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.349823:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 57 00000100:00100000:3.0:1788463629.368144:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.368260:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466910976 00000100:00100000:0.0:1788463629.368271:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466910976 00000100:00100000:0.0:1788463629.368340:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:0.0:1788463629.368351:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+37:15710:x1875339466910976:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.368373:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.368395:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b04e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c4d expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368523:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368556:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368570:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463629.368627:0:17056:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788463629.368709:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368717:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368724:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368729:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.368734:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368741:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368753:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463629.368757:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463629.368761:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368767:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b055 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368823:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b04e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c4d expref: 39 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368841:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff961884f9d300) 00010000:00010000:0.0:1788463629.368844:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463629.368848:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b04e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c4d expref: 39 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.368858:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5800, rc 0) 00000100:00100000:0.0:1788463629.368926:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+38:15710:x1875339466910976:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 577us (796us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788463629.368934:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 58 00000100:00100000:1.0:1788463629.385501:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.385679:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466911104 00000100:00100000:0.0:1788463629.385691:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466911104 00000100:00100000:0.0:1788463629.385753:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:0.0:1788463629.385764:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+38:15710:x1875339466911104:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463629.385814:0:18932:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463629.385943:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+38:15710:x1875339466911104:12345-192.168.204.53@tcp:53:lhsmtool_posix.0 Request processed in 180us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.385953:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 59 00000100:00100000:3.0:1788463629.393405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.393803:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466911360 00000100:00100000:0.0:1788463629.393816:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466911360 00000100:00100000:0.0:1788463629.393880:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:0.0:1788463629.393892:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+38:15710:x1875339466911360:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.393912:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.393944:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b063 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c54 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788463629.394385:0:17056:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1788463629.394391:0:17056:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788463629.394416:0:17056:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788463629.395305:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b06a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.395323:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b06a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.395335:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b06a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.395409:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b063 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c54 expref: 41 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.395427:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b06a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c54 expref: 40 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.395437:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145c00) 00010000:00010000:0.0:1788463629.395440:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463629.395444:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4a00, rc 0) 00000100:00100000:0.0:1788463629.395562:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+40:15710:x1875339466911360:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 1662us (2157us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788463629.395571:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 60 00000100:00100000:3.0:1788463629.402207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.402406:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466911616 00000100:00100000:0.0:1788463629.402417:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466911616 00000100:00100000:0.0:1788463629.402477:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:0.0:1788463629.402500:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+40:15710:x1875339466911616:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.402604:0:18932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463629.402632:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b06a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c54 expref: 40 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402663:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145c00) 00010000:00010000:0.0:1788463629.402674:0:18932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463629.402696:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402709:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402719:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402732:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402739:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402745:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402793:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402799:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402805:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402818:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5800 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.402823:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402831:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402840:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463629.402843:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.402847:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402853:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b078 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402863:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402869:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402874:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402879:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.402882:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402888:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402907:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc089a7bd (ffff961890145100) 00010000:00010000:0.0:1788463629.402910:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.402913:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.402920:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b07f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc089a7bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.403007:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96178700f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+39:15710:x1875339466911616:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 510us (811us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463629.403015:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 61 00000100:00100000:1.0:1788463629.408101:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.408188:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466911744 00000100:00100000:0.0:1788463629.408199:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466911744 00000100:00100000:0.0:1788463629.408265:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:0.0:1788463629.408289:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+39:15710:x1875339466911744:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.408313:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.408340:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b086 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c5b expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408382:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b08d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408397:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408410:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b08d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408545:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b086 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c5b expref: 41 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408570:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5800/0x841acb7f42a3b08d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c5b expref: 40 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.408627:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.408630:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463629.408634:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5800, rc 0) 00000100:00100000:0.0:1788463629.408694:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+40:15710:x1875339466911744:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 416us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.408701:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 62 00000100:00100000:3.0:1788463629.414248:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463629.414379:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912000 00000100:00100000:1.0:1788463629.414390:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912000 00000100:00100000:1.0:1788463629.414457:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:1.0:1788463629.414469:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+40:15710:x1875339466912000:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463629.414609:0:17058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.414627:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.414639:0:17058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463629.414824:0:17058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788463629.414833:0:17058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668866257489ns, next at 669866255244ns, rc = 0 00000004:00010000:1.0:1788463629.414880:0:17058:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005660c161 reply state 00000000470d86ce transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.414895:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.414903:0:17058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:1.0:1788463629.414906:0:17058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788463629.414910:0:17058:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463629.415074:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+42:15710:x1875339466912000:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 606us (836us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788463629.415099:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 63 00000100:00100000:1.0:1788463629.419888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.420004:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912128 00000100:00100000:0.0:1788463629.420014:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912128 00000100:00100000:0.0:1788463629.420130:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:0.0:1788463629.420143:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+42:15710:x1875339466912128:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.420168:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.420189:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c62 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.420247:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 43 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.420262:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 43 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.420300:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.420303:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463629.420320:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5000, rc 0) 00000100:00100000:0.0:1788463629.420381:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+43:15710:x1875339466912128:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 241us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.420389:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 64 00000100:00100000:1.0:1788463629.424496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.424657:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912256 00000100:00100000:3.0:1788463629.424667:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912256 00000100:00100000:3.0:1788463629.424730:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463629.424756:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+5:2400:x1875339466912256:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788463629.425182:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+6:2400:x1875339466912256:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 427us (706us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788463629.425191:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:3.0:1788463629.429673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463629.429786:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912512 00000100:00100000:1.0:1788463629.429795:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912512 00000100:00100000:1.0:1788463629.429850:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463629.429859:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+43:15710:x1875339466912512:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788463629.430103:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+44:15710:x1875339466912512:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 243us (442us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788463629.430111:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 11 00000100:00100000:1.0:1788463629.435801:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.435934:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912768 00000100:00100000:3.0:1788463629.435955:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912768 00000100:00100000:3.0:1788463629.436024:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:3.0:1788463629.436034:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+44:15710:x1875339466912768:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788463629.436413:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+44:15710:x1875339466912768:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 380us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463629.436421:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 65 00000100:00100000:2.0:1788463629.441436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.441562:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466912896 00000100:00100000:0.0:1788463629.441614:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466912896 00000100:00100000:0.0:1788463629.441679:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:0.0:1788463629.441691:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+44:15710:x1875339466912896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.441713:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.441739:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c69 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.441838:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.441856:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.441869:0:17057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463629.441917:0:17057:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788463629.441936:0:17057:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.441979:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c69 expref: 46 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.441997:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c69 expref: 45 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.442027:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.442031:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788463629.442035:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4200, rc 0) 00000100:00100000:0.0:1788463629.442094:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+45:15710:x1875339466912896:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 405us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.442101:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 66 00000100:00100000:2.0:1788463629.445840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.446025:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913024 00000100:00100000:0.0:1788463629.446035:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913024 00000100:00100000:0.0:1788463629.446086:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:0.0:1788463629.446095:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+6:2401:x1875339466913024:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.446114:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.446138:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c70 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463629.446168:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99ca0d, blocks: 0x0 00010000:00010000:0.0:1788463629.446187:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=668s v=(0 0) 00010000:00010000:0.0:1788463629.446191:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463629.446201:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.446220:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 7 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.446233:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4400, rc 0) 00000100:00100000:0.0:1788463629.446515:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:2401:x1875339466913024:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 419us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.446522:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 24 00000100:00100000:1.0:1788463629.454217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.454310:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913280 00000100:00100000:0.0:1788463629.454322:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913280 00000100:00100000:0.0:1788463629.454392:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:0.0:1788463629.454404:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+45:15710:x1875339466913280:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788463629.454537:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+45:15710:x1875339466913280:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 135us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.454546:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 67 00000100:00100000:2.0:1788463629.460963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.461361:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913408 00000100:00100000:0.0:1788463629.461373:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913408 00000100:00100000:0.0:1788463629.461437:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 68 00000100:00100000:0.0:1788463629.461448:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+45:15710:x1875339466913408:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788463629.464498:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788463629.464516:0:17036:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788463629.464625:0:17036:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788463629.464768:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+20:15710:x1875339466913408:12345-192.168.204.53@tcp:44:lhsmtool_posix.0 Request processed in 3316us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.464791:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 68 00010000:00010000:1.0:1788463629.464908:0:3635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.464920:0:3635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.464927:0:3635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.464934:0:3635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:1.0:1788463629.464939:0:3635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.464956:0:3635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.464987:0:3635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:1.0:1788463629.464990:0:3635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788463629.464996:0:3635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.465002:0:3635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3aec6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465627:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465646:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465652:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465657:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdfe00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.465660:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465666:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465676:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff961884f9db00) 00010000:00010000:2.0:1788463629.465679:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.465682:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465688:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdfe00/0x841acb7f42a3ae72 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465707:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465712:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465718:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465722:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.465730:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465736:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465744:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:2.0:1788463629.465746:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.465748:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465754:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4600/0x841acb7f42a3ae79 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465765:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465782:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465788:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465792:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618c1e27400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.465795:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465800:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465807:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961894655200) 00010000:00010000:2.0:1788463629.465809:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.465818:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465824:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618c1e27400/0x841acb7f42a3af21 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465840:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465846:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465851:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465855:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00ea00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.465857:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465862:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465869:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463629.465871:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.465873:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465879:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00ea00/0x841acb7f42a3afa6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465889:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465903:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465908:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465912:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21e00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.465915:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465921:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465928:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463629.465930:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.465932:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.465938:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21e00/0x841acb7f42a3afc9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466044:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466050:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466055:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466061:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5a00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.466069:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466075:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466084:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463629.466086:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463629.466089:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466094:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5a00/0x841acb7f42a3b00f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466192:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466200:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466205:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466210:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bdf200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.466212:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466218:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466225:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:2.0:1788463629.466227:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463629.466239:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.466245:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf200/0x841acb7f42a3b094 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.466972:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463629.466991:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485877632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463629.467057:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463629.467371:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485877632 00000100:00100000:3.0:1788463629.467378:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485877632 00000100:00100000:3.0:1788463629.467436:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463629.467446:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875339485877632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788463629.467606:0:18562:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788463629.467610:0:18562:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788463629.467611:0:18562:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463629.467614:0:18562:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788463629 -> 1788463629 00002000:00010000:3.0:1788463629.467616:0:18562:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788463629.467662:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875339485877632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 217us (605us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788463629.467669:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:2.0:1788463629.468974:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff961786b47100/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788463629.468987:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485877632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463629.470013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.470146:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913536 00000100:00100000:0.0:1788463629.470155:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913536 00000100:00100000:0.0:1788463629.470211:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:0.0:1788463629.470222:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:2400:x1875339466913536:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788463629.470346:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:2400:x1875339466913536:12345-192.168.204.53@tcp:16:lhsmtool_posix.0 Request processed in 126us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.470354:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 26 00000100:00100000:1.0:1788463629.473212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.473296:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913792 00000100:00100000:0.0:1788463629.473305:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913792 00000100:00100000:0.0:1788463629.473366:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:0.0:1788463629.473375:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+14:15710:x1875339466913792:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.473431:0:18932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463629.473459:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c69 expref: 14 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.473504:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.473510:0:18932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463629.473541:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.473555:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.473564:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463629.473722:0:18932:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042559093 reply state 00000000102b40d2 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.473736:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4a00/0x841acb7f42a3b0b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.473743:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.473759:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788463629.473762:0:18932:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463629.473870:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+15:15710:x1875339466913792:12345-192.168.204.53@tcp:36:lhsmtool_posix.0 Request processed in 495us (665us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788463629.473878:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 69 00000100:00100000:2.0:1788463629.476616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.476887:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466913920 00000100:00100000:3.0:1788463629.476896:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466913920 00000100:00100000:3.0:1788463629.476976:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:3.0:1788463629.476986:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+7:15710:x1875339466913920:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463629.477004:0:18562:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463629.477022:0:18562:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c77 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.477054:0:18562:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.477063:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463629.477067:0:18562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463629.477073:0:18562:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 8 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.477109:0:18562:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 8 pid: 18933 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.477123:0:18562:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 8 pid: 18933 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463629.477136:0:18562:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961786b44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18562:1875339485877760:192.168.204.53@tcp:104: 00000100:00100000:3.0:1788463629.477222:0:18562:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618843e2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463629.482083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.482228:0:20084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914048 00000100:00100000:0.0:1788463629.482238:0:20084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914048 00010000:00010000:0.0:1788463629.482279:0:20084:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 9 pid: 18933 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.482324:0:20084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:0.0:1788463629.482338:0:20084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+9:2401:x1875339466914048:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463629.482354:0:20084:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463629.482375:0:20084:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 9 pid: 18933 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.482390:0:20084:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 9 pid: 18933 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.482415:0:20084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463629.482420:0:20084:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463629.482427:0:20084:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.482442:0:20084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.482512:0:20084:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.482527:0:20084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20084:1875339485877888:192.168.204.53@tcp:105: 00000100:00100000:0.0:1788463629.482633:0:20084:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a840 going to sleep for 11 seconds 00010000:00010000:3.0:1788463629.483409:0:18562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0132ca/0x841acb7f42a3b0b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c70 expref: 9 pid: 18933 timeout: 768 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463629.483429:0:18562:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961786b44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18562:1875339485877760:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463629.483466:0:18562:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 8 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.483490:0:18562:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9618be00f400, rc 0) 00000100:00100000:3.0:1788463629.483543:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+8:15710:x1875339466913920:12345-192.168.204.53@tcp:101:lhsmtool_posix.0 Request processed in 6557us (6972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463629.483551:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 27 00000100:00100000:0.0:1788463629.487417:0:20084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20084:1875339485877888:192.168.204.53@tcp:105: 00010000:00010000:0.0:1788463629.487445:0:20084:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463629.487516:0:20084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:2401:x1875339466914048:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 5179us (5446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.487527:0:20084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 20 00000100:00100000:2.0:1788463629.489757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.489905:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914176 00000100:00100000:0.0:1788463629.489915:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914176 00000100:00100000:0.0:1788463629.489980:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:0.0:1788463629.489990:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:2401:x1875339466914176:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788463629.490137:0:18933:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788463629.490141:0:18933:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788463628 00002000:00010000:0.0:1788463629.490144:0:18933:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788463627 00002000:00010000:0.0:1788463629.490145:0:18933:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788463629 -> 1788463628 00002000:00010000:0.0:1788463629.490148:0:18933:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788463629.490210:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+8:2401:x1875339466914176:12345-192.168.204.53@tcp:2:lhsmtool_posix.0 Request processed in 220us (463us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788463629.490218:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 28 00000100:00100000:2.0:1788463629.495294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463629.495626:0:18563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914304 00000100:00100000:1.0:1788463629.495636:0:18563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914304 00000100:00100000:1.0:1788463629.495694:0:18563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:1.0:1788463629.495704:0:18563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+8:2400:x1875339466914304:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788463629.495749:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.495781:0:18563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 8 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.495790:0:18563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463629.495795:0:18563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463629.495800:0:18563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.495838:0:18563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 8 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.495871:0:18563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 8 pid: 18562 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463629.495886:0:18563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18563:1875339485878016:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463629.495974:0:18563:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463629.500909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463629.501043:0:18563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18563:1875339485878016:192.168.204.53@tcp:104: 00010000:00010000:1.0:1788463629.501074:0:18563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463629.507667:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914432 00000100:00100000:3.0:1788463629.507683:0:17041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914432 00010000:00010000:3.0:1788463629.507744:0:17041:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463629.507807:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 21 00000100:00100000:3.0:1788463629.507818:0:17041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b4f176-a68a-42e0-807e-b5954986c863+9:2401:x1875339466914432:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463629.507834:0:17041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463629.507858:0:17041:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.507874:0:17041:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.507896:0:17041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039b1622d/0x841acb7f42a3b0be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c77 expref: 9 pid: 18562 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.507914:0:17041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463629.507933:0:17041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463629.508106:0:17041:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.508120:0:17041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.508157:0:17041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463629.508272:0:17041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:11b4f176-a68a-42e0-807e-b5954986c863+8:2401:x1875339466914432:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 455us (7375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463629.508284:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 21 00010000:00010000:1.0:1788463629.508364:0:18563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508374:0:18563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508398:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508407:0:18563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508416:0:18563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508436:0:18563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde600 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:1.0:1788463629.508441:0:18563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508450:0:18563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508463:0:18563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.508471:0:18563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d65bd5/0x841acb7f42a3b0c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463629.508534:0:18563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:11b4f176-a68a-42e0-807e-b5954986c863+7:2400:x1875339466914304:12345-192.168.204.53@tcp:1:lhsmtool_posix.0 Request processed in 12830us (13263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463629.508542:0:18563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 29 00000100:00100000:2.0:1788463629.513532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.513919:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914688 00000100:00100000:0.0:1788463629.514014:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914688 00000100:00100000:0.0:1788463629.514113:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 70 00000100:00100000:0.0:1788463629.514124:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+15:15710:x1875339466914688:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788463629.514211:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.514229:0:17056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 15 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.514239:0:17056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.514273:0:17056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 15 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.514464:0:17056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 15 pid: 17057 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.514494:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878144:192.168.204.53@tcp:104: 00000100:00100000:0.0:1788463629.514741:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188541a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463629.521414:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:1.0:1788463629.521532:0:17042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914816 00000100:00100000:1.0:1788463629.521543:0:17042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914816 00010000:00010000:1.0:1788463629.521612:0:17042:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 16 pid: 17057 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463629.521661:0:17042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 22 00000100:00100000:1.0:1788463629.521671:0:17042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+16:2401:x1875339466914816:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463629.521685:0:17042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463629.521704:0:17042:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 16 pid: 17057 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521717:0:17042:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 16 pid: 17057 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521738:0:17042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:1.0:1788463629.521744:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 16 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521753:0:17042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521761:0:17042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521768:0:17042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.521788:0:17042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463629.521836:0:17042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:11b4f176-a68a-42e0-807e-b5954986c863+16:2401:x1875339466914816:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 167us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463629.521844:0:17042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 22 00010000:00010000:0.0:1788463629.522443:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bdf600/0x841acb7f42a3af9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c15 expref: 15 pid: 17057 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.522460:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878144:192.168.204.53@tcp:104: 00010000:00010000:0.0:1788463629.522489:0:17056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.522499:0:17056:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.522514:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.523006:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.523020:0:17056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 15 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.523028:0:17056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.523062:0:17056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 15 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463629.523075:0:17056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 15 pid: 17056 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463629.523089:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878272:192.168.204.53@tcp:104: 00000100:00100000:1.0:1788463629.523161:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9617878b1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463629.527836:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.528083:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878272:192.168.204.53@tcp:104: 00010000:00010000:3.0:1788463629.528124:0:17056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.528444:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466914944 00000100:00100000:0.0:1788463629.528452:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466914944 00010000:00010000:0.0:1788463629.528504:0:17043:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 16 pid: 17056 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.528544:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 23 00000100:00100000:0.0:1788463629.528554:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961884f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b4f176-a68a-42e0-807e-b5954986c863+16:2401:x1875339466914944:12345-192.168.204.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463629.528569:0:17043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463629.528604:0:17043:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 16 pid: 17056 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528616:0:17043:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 16 pid: 17056 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528639:0:17043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5000/0x841acb7f42a3b09b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c62 expref: 16 pid: 17056 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528654:0:17043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.528660:0:17043:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528669:0:17043:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528677:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.528723:0:17043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463629.529052:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961884f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:11b4f176-a68a-42e0-807e-b5954986c863+15:2401:x1875339466914944:12345-192.168.204.53@tcp:103:ldlm_bl.0 Request processed in 497us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.529060:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 23 00010000:00010000:2.0:1788463629.529550:0:17056:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.529561:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463629.529712:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788463629.529852:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788463629.529888:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788463629.529985:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17056:1875339485878400:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788463629.530041:0:17056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463629.530074:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff9618915e1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463629.532071:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485878400 00000100:00100000:3.0:1788463629.532085:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485878400 00000100:00100000:3.0:1788463629.532380:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463629.532391:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17056:x1875339485878400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788463629.532547:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17056:x1875339485878400:12345-0@lo:1000:mdt00_000.0 Request processed in 150us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463629.532555:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463629.532655:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17056:1875339485878400:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788463629.532884:0:17056:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788463629.532973:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17056:1875339485878528:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788463629.533012:0:17056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463629.533692:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff961884f21900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463629.533889:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485878528 00000100:00100000:1.0:1788463629.533896:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485878528 00000100:00100000:3.0:1788463629.534068:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788463629.534080:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17056:x1875339485878528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788463629.534226:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17056:x1875339485878528:12345-0@lo:1000:mdt00_000.0 Request processed in 149us (1213us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788463629.534234:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463629.534507:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17056:1875339485878528:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788463629.534667:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534677:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534684:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534690:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961786bde600 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.534694:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534877:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534893:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:2.0:1788463629.534896:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463629.534901:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.534908:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961786bde600/0x841acb7f42a3b0d3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535073:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535089:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535095:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535099:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e21200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:2.0:1788463629.535102:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535108:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535117:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:2.0:1788463629.535119:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463629.535127:0:17056:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 18 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535138:0:17056:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 18 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535148:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 18 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.535206:0:17056:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4e00/0x841acb7f42a3b032 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c46 expref: 18 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463629.535219:0:17056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878656:192.168.204.53@tcp:105: 00000100:00100000:2.0:1788463629.535312:0:17056:0:(client.c:2716:ptlrpc_set_wait()) set ffff96188688a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463629.541291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.541327:0:17056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618c1b26300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17056:1875339485878656:192.168.204.53@tcp:105: 00010000:00010000:3.0:1788463629.541359:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541370:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e21200/0x841acb7f42a3b02b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17057 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541405:0:17056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541419:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541431:0:17056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541441:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541447:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541454:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541459:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9618be00f400 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463629.541463:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541470:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541492:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463629.541509:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463629.541513:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541519:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9618be00f400/0x841acb7f42a3b0da lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.541531:0:17056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463629.541690:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466915072 00000100:00100000:1.0:1788463629.541697:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466915072 00000100:00100000:1.0:1788463629.541750:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 12 00000100:00100000:1.0:1788463629.541759:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+19:15708:x1875339466915072:12345-192.168.204.53@tcp:49:bash.0 00000100:00100000:1.0:1788463629.542066:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:11b4f176-a68a-42e0-807e-b5954986c863+19:15708:x1875339466915072:12345-192.168.204.53@tcp:49:bash.0 Request processed in 306us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463629.542074:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 12 00010000:00010000:3.0:1788463629.545628:0:17056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.545647:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.545654:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4200 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:3.0:1788463629.545659:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.545668:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.545686:0:17056:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:3.0:1788463629.545690:0:17056:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463629.545695:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463629.545713:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4200/0x841acb7f42a3b0cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17056 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463629.546008:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+18:15710:x1875339466914688:12345-192.168.204.53@tcp:57:lhsmtool_posix.0 Request processed in 31880us (32483us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788463629.546019:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 70 00000020:00080000:2.0:1788463629.546025:0:17056:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788463629.546090:0:17093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788463629.546095:0:17093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463629.546109:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788463629.546116:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788463629.547457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.547565:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466915200 00000100:00100000:0.0:1788463629.547606:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466915200 00000100:00100000:0.0:1788463629.547650:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:0.0:1788463629.547661:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+7:15708:x1875339466915200:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463629.547684:0:18933:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.547716:0:18933:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3b0e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c7e expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463629.547740:0:18933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a99ca0c, atime: 0x6a99ca0b, ctime: 0x6a99ca0c, blocks: 0x0 00010000:00010000:0.0:1788463629.547762:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=668s v=(0 0) 00010000:00010000:0.0:1788463629.547767:0:18933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463629.547786:0:18933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3b0e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c7e expref: 8 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.547802:0:18933:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9b7a5d1/0x841acb7f42a3b0e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c7e expref: 8 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.547815:0:18933:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5000, rc 0) 00000100:00100000:0.0:1788463629.547873:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:11b4f176-a68a-42e0-807e-b5954986c863+8:15708:x1875339466915200:12345-192.168.204.53@tcp:101:bash.0 Request processed in 214us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.547880:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 30 00000100:00100000:3.0:1788463629.553232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463629.553283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.554733:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466915584 00000100:00100000:0.0:1788463629.554748:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466915584 00000100:00100000:0.0:1788463629.554814:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:0.0:1788463629.554825:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+18:15708:x1875339466915584:12345-192.168.204.53@tcp:101:bash.0 00010000:00010000:0.0:1788463629.554850:0:18932:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.554874:0:18932:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b0e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c85 expref: -99 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.554911:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b0ef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.554927:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b0ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.554941:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b0ef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.555056:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b0e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c85 expref: 20 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.555074:0:18932:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5600/0x841acb7f42a3b0ef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c85 expref: 19 pid: 18932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.555083:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463629.555085:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463629.555089:0:18932:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f5600, rc 0) 00000100:00100000:0.0:1788463629.555162:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+19:15708:x1875339466915584:12345-192.168.204.53@tcp:101:bash.0 Request processed in 338us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.555171:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 71 00000100:00100000:2.0:1788463629.561059:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466915456 00000100:00100000:2.0:1788463629.561076:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466915456 00000100:00100000:2.0:1788463629.561157:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 13 00000100:00100000:2.0:1788463629.561168:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+19:15710:x1875339466915456:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788463629.561459:0:17060:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788463629.561506:0:17060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788463629.561547:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561565:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561607:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561617:0:17060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561623:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561629:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463629.561667:0:17060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463629.561797:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+21:15710:x1875339466915456:12345-192.168.204.53@tcp:35:lhsmtool_posix.0 Request processed in 629us (8511us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788463629.561806:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 13 00000020:00080000:2.0:1788463629.561813:0:17060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463629.562743:0:17045:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463629.562756:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.562765:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961785e20a00 already unused, calling callback (ffffffffc0d664f0) 00010000:00010000:0.0:1788463629.562778:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.562788:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.562804:0:17045:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff961890145100) 00010000:00010000:0.0:1788463629.562808:0:17045:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463629.562813:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.562819:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961785e20a00/0x841acb7f42a3b0f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.562832:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463629.562833:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463629.562835:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463629.565792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463629.567149:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466915840 00000100:00100000:2.0:1788463629.567163:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466915840 00000100:00100000:2.0:1788463629.567230:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 14 00000100:00100000:2.0:1788463629.567241:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+21:15708:x1875339466915840:12345-192.168.204.53@tcp:35:bash.0 00000001:00080000:2.0:1788463629.567468:0:17060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788463629.568119:0:17060:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788463629.568290:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961786b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+24:15708:x1875339466915840:12345-192.168.204.53@tcp:35:bash.0 Request processed in 1047us (2514us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788463629.568299:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 14 00000020:00080000:2.0:1788463629.568304:0:17060:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788463629.702997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.703152:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916096 00000100:00100000:0.0:1788463629.703164:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916096 00000100:00100000:0.0:1788463629.703228:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:0.0:1788463629.703239:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+24:15720:x1875339466916096:12345-192.168.204.53@tcp:101:lfs.0 00010000:00010000:0.0:1788463629.703265:0:17057:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463629.703301:0:17057:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x51bfae1fdc476c8c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463629.703421:0:17057:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788463629.703658:0:17057:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b0fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c8c expref: 26 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.703674:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961885469800) 00010000:00010000:0.0:1788463629.703677:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463629.703682:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b0fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.53@tcp remote: 0x51bfae1fdc476c8c expref: 26 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.703696:0:17057:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96188f6f4c00, rc 0) 00000100:00100000:0.0:1788463629.703860:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:11b4f176-a68a-42e0-807e-b5954986c863+25:15720:x1875339466916096:12345-192.168.204.53@tcp:101:lfs.0 Request processed in 621us (884us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788463629.703868:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 72 00000100:00100000:1.0:1788463629.711984:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.712441:0:18932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916224 00000100:00100000:0.0:1788463629.712453:0:18932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916224 00000100:00100000:0.0:1788463629.712535:0:18932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:0.0:1788463629.712548:0:18932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618bf5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+25:15720:x1875339466916224:12345-192.168.204.53@tcp:34:lfs.0 00010000:00010000:0.0:1788463629.712673:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712691:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712703:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712737:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712744:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712750:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712841:0:18932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712851:0:18932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712859:0:18932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463629.712909:0:18932:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712923:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712931:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712951:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712957:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.712961:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712978:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.712992:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff961890145600) 00010000:00010000:0.0:1788463629.712995:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.713001:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713007:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4c00/0x841acb7f42a3b10b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713021:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713027:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713033:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713038:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f5c00 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.713040:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713045:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713051:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff961890145200) 00010000:00010000:0.0:1788463629.713054:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.713057:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713072:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f5c00/0x841acb7f42a3b112 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713089:0:18932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713095:0:18932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713101:0:18932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713652:0:18932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96188f6f4000 already unused, calling callback (ffffffffc19744f0) 00010000:00010000:0.0:1788463629.713655:0:18932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713663:0:18932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713673:0:18932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff961894655400) 00010000:00010000:0.0:1788463629.713675:0:18932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463629.713679:0:18932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463629.713684:0:18932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96188f6f4000/0x841acb7f42a3b119 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18932 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463629.713786:0:18932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618bf5c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:11b4f176-a68a-42e0-807e-b5954986c863+25:15720:x1875339466916224:12345-192.168.204.53@tcp:34:lfs.0 Request processed in 1237us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463629.713796:0:18932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:2.0:1788463629.719993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:0.0:1788463629.721507:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916480 00000100:00100000:0.0:1788463629.721521:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916480 00000100:00100000:0.0:1788463629.721612:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 15 00000100:00100000:0.0:1788463629.721623:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+25:15720:x1875339466916480:12345-192.168.204.53@tcp:35:lfs.0 00000100:00100000:0.0:1788463629.721862:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:11b4f176-a68a-42e0-807e-b5954986c863+26:15720:x1875339466916480:12345-192.168.204.53@tcp:35:lfs.0 Request processed in 239us (1879us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788463629.721870:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 15 00010000:00010000:1.0:1788463629.962604:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463630.980768:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463631.609974:0:20236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788463632.003899:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463632.629240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463632.629317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463632.629725:0:18562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916736 00000100:00100000:3.0:1788463632.629735:0:18562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916736 00000100:00100000:3.0:1788463632.629830:0:18562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00100000:3.0:1788463632.629842:0:18562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+8:2403:x1875339466916736:12345-192.168.204.53@tcp:16:kworker.0 00000100:00100000:1.0:1788463632.629853:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916608 00000100:00100000:1.0:1788463632.629860:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916608 00002000:00100000:1.0:1788463632.629892:0:18567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9618c1b27480 x1875339466916608/t0(0) o4->11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp:13/0 lens 504/0 e 0 to 0 dl 1788463643 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788463632.629909:0:18567:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b27480 with x1875339466916608 ext(0->8) 00002000:00010000:1.0:1788463632.629929:0:18567:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9618c1b27480 00000100:00100000:1.0:1788463632.629953:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 0 00000100:00100000:3.0:1788463632.629967:0:18562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:11b4f176-a68a-42e0-807e-b5954986c863+9:2403:x1875339466916736:12345-192.168.204.53@tcp:16:kworker.0 Request processed in 124us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463632.629968:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11b4f176-a68a-42e0-807e-b5954986c863+9:2403:x1875339466916608:12345-192.168.204.53@tcp:4:bash.0 00000100:00100000:3.0:1788463632.629983:0:18562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 31 00000100:00080000:2.0:1788463632.630234:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463632.638051:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:11b4f176-a68a-42e0-807e-b5954986c863+10:2403:x1875339466916608:12345-192.168.204.53@tcp:4:bash.0 Request processed in 8078us (8809us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788463632.638067:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 0 00002000:00100000:1.0:1788463632.638080:0:18567:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff9618c1b27480 x1875339466916608/t8589934599(0) o4->11b4f176-a68a-42e0-807e-b5954986c863@192.168.204.53@tcp:13/0 lens 504/448 e 0 to 0 dl 1788463643 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788463632.638090:0:18567:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9618c1b27480 with x1875339466916608 ext(0->8) 00002000:00010000:1.0:1788463632.638096:0:18567:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9618c1b27480 00010000:00010000:1.0:1788463633.032957:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463633.148207:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148258:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148343:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:2.0:1788463633.148384:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917376 00000100:00100000:2.0:1788463633.148395:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917376 00000100:00100000:2.0:1788463633.148450:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917248 00000100:00100000:2.0:1788463633.148454:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917248 00000100:00100000:2.0:1788463633.148467:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917760 00000100:00100000:2.0:1788463633.148470:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917760 00000100:00100000:2.0:1788463633.148480:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917888 00000100:00100000:2.0:1788463633.148482:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917888 00000100:00100000:2.0:1788463633.148498:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463633.148507:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+10:2400:x1875339466917248:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:2.0:1788463633.148592:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+10:2400:x1875339466917248:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 68us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463633.148601:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463633.148620:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463633.148627:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2399:x1875339466917376:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:2.0:1788463633.148646:0:18564:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3ad76 00000100:00080000:2.0:1788463633.148661:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961781702800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463633.148704:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788463633.148822:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:11b4f176-a68a-42e0-807e-b5954986c863+2:2399:x1875339466917376:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 195us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463633.148829:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 32 00000100:00100000:2.0:1788463633.148842:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463633.148848:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2399:x1875339466917760:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:2.0:1788463633.148858:0:18564:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3adae 00000100:00080000:2.0:1788463633.148865:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961781701800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463633.148886:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788463633.148951:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+2:2399:x1875339466917760:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 103us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463633.148965:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 33 00000100:00100000:2.0:1788463633.148978:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00100000:2.0:1788463633.148985:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2399:x1875339466917888:12345-192.168.204.53@tcp:9:kworker.0 00000020:00000080:2.0:1788463633.148996:0:18564:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x841acb7f42a3adb5 00000100:00080000:2.0:1788463633.149001:0:18564:0:(import.c:65:import_set_state_nolock()) ffff961781702000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463633.149017:0:18564:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788463633.149068:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+2:2399:x1875339466917888:12345-192.168.204.53@tcp:9:kworker.0 Request processed in 82us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463633.149075:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 34 00000100:00080000:2.0:1788463633.149094:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463633.149097:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788463633.149208:0:17044:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463633.149215:0:17045:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463633.149345:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916992 00000100:00100000:3.0:1788463633.149350:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916992 00000100:00100000:3.0:1788463633.149392:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917632 00000100:00100000:3.0:1788463633.149395:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917632 00000100:00100000:3.0:1788463633.149426:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:3.0:1788463633.149433:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+26:2400:x1875339466916992:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463633.149473:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:11b4f176-a68a-42e0-807e-b5954986c863+26:2400:x1875339466916992:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 41us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463633.149479:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 73 00000100:00100000:3.0:1788463633.149490:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:3.0:1788463633.149496:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2400:x1875339466917632:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463633.149517:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9618c1b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+5:2400:x1875339466917632:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 22us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463633.149523:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 74 00000100:00100000:3.0:1788463633.154380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463633.154443:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463633.154473:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.53@tcp (source: 12345-192.168.204.53@tcp) 00000100:00100000:3.0:1788463633.154497:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917120 00000100:00100000:3.0:1788463633.154518:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917120 00000100:00100000:0.0:1788463633.154675:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466916864 00000100:00100000:0.0:1788463633.154680:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466916864 00000100:00100000:0.0:1788463633.154729:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:0.0:1788463633.154740:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2401:x1875339466916864:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:0.0:1788463633.154806:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c701ce0f-5243-483e-b03d-f799276c6ff2+13:2401:x1875339466916864:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 69us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463633.154814:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 169 00000100:00100000:3.0:1788463633.154994:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339466917504 00000100:00100000:3.0:1788463633.154998:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339466917504 00000100:00100000:3.0:1788463633.155023:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:3.0:1788463633.155029:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466917120:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463633.155068:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:11b4f176-a68a-42e0-807e-b5954986c863+5:2401:x1875339466917120:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 38us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463633.155074:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 75 00000100:00100000:3.0:1788463633.155087:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00100000:3.0:1788463633.155093:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2401:x1875339466917504:12345-192.168.204.53@tcp:400:kworker.0 00000100:00100000:3.0:1788463633.155127:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9617884d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a56831b-aebb-4a8f-ae8e-45964e8f9ab4+6:2401:x1875339466917504:12345-192.168.204.53@tcp:400:kworker.0 Request processed in 34us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463633.155133:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.53@tcp, seq: 76 00000100:00080000:2.0:1788463633.155622:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788463633.155627:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463633.796042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485878784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463633.796112:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463633.796162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463633.796168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485878912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788463633.796187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463633.796215:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485879040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463633.796235:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463633.796246:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463633.796251:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485879168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788463633.796268:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463633.796312:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485878784 00000100:00100000:0.0:1788463633.796320:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485878784 00000100:00100000:0.0:1788463633.796362:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485878912 00000100:00100000:0.0:1788463633.796364:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485878912 00000100:00100000:0.0:1788463633.796374:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879040 00000100:00100000:0.0:1788463633.796376:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879040 00000100:00100000:0.0:1788463633.796386:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879168 00000100:00100000:0.0:1788463633.796388:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879168 00000100:00100000:0.0:1788463633.796414:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463633.796421:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485878784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463633.796449:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788463633.796488:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485878784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463633.796494:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463633.796512:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463633.796518:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485878912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788463633.796528:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788463633.796550:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875339485878912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463633.796556:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463633.796567:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463633.796595:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485879040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463633.796608:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788463633.796638:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875339485879040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463633.796643:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463633.796654:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463633.796660:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485879168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788463633.796675:0:18566:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923505152 avail 3691982848 00000100:00080000:1.0:1788463633.797111:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463633.797116:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463633.797128:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485879552:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801571:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485880064:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801615:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801669:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3650:1875339485879040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463633.801696:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788463633.801703:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485879680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801732:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801751:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485880192:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801770:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485879296:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801851:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485879808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801925:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485880320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.801943:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.801967:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3648:1875339485878912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788463633.801983:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485878784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463633.802000:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463633.802006:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802029:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.802047:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff961788ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485879936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802068:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463633.802090:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879680 00000100:00100000:1.0:1788463633.802097:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879680 00000100:00100000:1.0:1788463633.802136:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879424 00000100:00100000:1.0:1788463633.802139:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879424 00000100:00100000:1.0:1788463633.802154:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463633.802162:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485879680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802214:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485879680:12345-0@lo:400:kworker.0 Request processed in 53us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802221:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463633.802236:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788463633.802243:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802273:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875339485879424:12345-0@lo:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802309:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788463633.802339:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485879680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802362:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3648:1875339485879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802421:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879552 00000100:00100000:1.0:1788463633.802425:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879552 00000100:00100000:1.0:1788463633.802447:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880064 00000100:00100000:1.0:1788463633.802451:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880064 00000100:00100000:1.0:1788463633.802473:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880192 00000100:00100000:1.0:1788463633.802476:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880192 00000100:00100000:1.0:1788463633.802487:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879808 00000100:00100000:1.0:1788463633.802489:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879808 00000100:00100000:1.0:1788463633.802499:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485880320 00000100:00100000:1.0:1788463633.802502:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485880320 00000100:00100000:1.0:1788463633.802511:0:17057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879936 00000100:00100000:1.0:1788463633.802513:0:17057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879936 00000100:00100000:1.0:1788463633.802527:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788463633.802533:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485879552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802568:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875339485879552:12345-0@lo:400:kworker.0 Request processed in 36us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802604:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788463633.802616:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463633.802622:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485880064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802646:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875339485880064:12345-0@lo:400:kworker.0 Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802651:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463633.802662:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463633.802667:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485880192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802704:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875339485880192:12345-0@lo:400:kworker.0 Request processed in 37us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802711:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463633.802722:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788463633.802728:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485879808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802757:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875339485879808:12345-0@lo:400:kworker.0 Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802762:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788463633.802774:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463633.802780:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485880320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802804:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875339485880320:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802809:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463633.802819:0:17057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788463633.802823:0:17057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961788cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485879936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802846:0:17057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961788cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875339485879936:12345-0@lo:400:kworker.0 Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463633.802852:0:17057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788463633.802868:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463633.802872:0:17052:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788463633.802889:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3650:1875339485880192:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802899:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875339485879552:0@lo:400:kworker.0 00010000:00080000:1.0:1788463633.802911:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788ca9c00 x1875339485880064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463633.802933:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3650:1875339485880064:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802959:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3648:1875339485879936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463633.802969:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875339485879808:0@lo:400:kworker.0 00010000:00080000:1.0:1788463633.802977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff961788ca9880 x1875339485880320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463633.802985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff961788ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3648:1875339485880320:0@lo:400:kworker.0 00000100:00100000:3.0:1788463633.804821:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339485879296 00000100:00100000:3.0:1788463633.804835:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339485879296 00000100:00100000:3.0:1788463633.804899:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788463633.804909:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485879296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463633.804986:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff961781bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:61537c78-f571-4169-84d6-9d8a2058e62c+24:3648:x1875339485879296:12345-0@lo:400:kworker.0 Request processed in 79us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463633.804993:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788463633.805044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9618bf5c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:61537c78-f571-4169-84d6-9d8a2058e62c:3648:1875339485879296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463633.808540:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96188fc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875339485879168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11869us (12259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463633.808555:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463633.808882:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff96188fc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3650:1875339485879168:0@lo:13:osp-pre-0-1.0 Debug log: 44952 lines, 44952 kept, 0 dropped, 0 bad.